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A STUDY OF THE RELATIONSHIP OF SCORES 
ON THE MMPI TO SUCCESS IN TEACHING AS 
INDICATED BY SUPERVISORY RATINGS 


CARROLL EDWARD FLANAGAN* 
Wisconsin State College 
Whitewater, Wisconsin 


SECTION I 


The Problem and Its Background 


THE PURPOSE of this investigation is to study 
the relationship between certain aspects of per- 
sonality andteacher efficiency. More specifically, 
the study is of the relationship between scores 
and profile patternson the Minnesota Multiphasic 
Personality Inventory and success in teaching as 
indicated by principals’ and superintendents’ rat- 
ings. 

There is considerable evidence from previous 
research to indicate that teacher ratings based on 
pupil gains and supervisory ratings of teachers 
are not highly correlated. Rostker!** and Lins2, 
for example, each concluded that pupil gain and 
supervisory ratings are not related to a greater 
degree than can be attributed to chance. Lins 
stated, ‘‘Whatever is measured by each of the 
criteria, at least it appears evident that these 
criteria do not measure the same aspects of teach- 
ing efficiency.’’3 LaDuke* summarized, ‘‘ Ratings 
of teachers do not agree with the criterion of pu- 
pil gain. ”’ 

Supervisory ratings of teachers, then, must 
pertain to something other thanefficiency in pro- 
moting pupil gain. They probably pertain to the 
personal characteristics of teachers and effec- 
tiveness indiscipline. An examination of the ver- 
bal statements relative tothe strengths and weak- 
nesses of the teachers rated by the principals and 
supervisors responding to the inquiry would seem 
to indicate that, except for discipline, the pri- 
mary concern of the raters was with the person- 
al characteristics of teachers. 

The value systems used by principals and su- 
pervisors in rating teachers differto a consider- 
able degree. This, which would tend to reduce 
correlations to zero, is a possible reason for the 


low correlations between the supervisory rating 
and. the pupil gain criteria. It would seem that 
any relationships which have been found between 
supervisory ratings and other data exist in spite 
of the diversity in supervisors’ value systems. 

Regardless ofthe meaning of supervisory 
ratings, teachers are usually judged by their su- 
pervisors and administrators. In general, these 
evaluations are made upon the basis of general 
impressions made ofthe teacher in many person- 
al contacts, inobserving classroom performance, 
and upon reports from others, rather than from 
a single objective measure of teaching efficiency. 
The impressions may dependtoa large extent up- 
on the teacher’s personality, but the evaluation, 
whatever its basis, becomes the official evalua- 
tion of the particular school system in which the 
teacher is employed. Regardless of what else 
the teacher may have done, right or wrong, if he 
pleases the administration he is rated highly and 
consequently is considered to be a good teacher. 

It can be said, also, that in spite of the inade- 
quacies of supervisory ratings, the local admin- 
istrator or supervisor shouldbe in a better posi- 
tion to judge the abilities of the teacher than per- 
sons who must base their judgments on limited 
observation. Inany case, it seems that super- 
visory ratings are very important when consid- 
ering a teacher’s success. 

As to the aspect of te ac hing here chosen for 
study, a teacher’s personality is apt, according 
to the thinking and researches of many persons, 
to influence his success inteaching. Various 
qualities affect his classroom effectiveness, his 
enthusiasm, his pupil contacts, his discipline, 
his contacts with fellow teachers and with the cit- 
izens of his community, or other aspects of his 
life as a teacher. Certainly, extreme abnorm- 
alities in personality determine ateacher’s effec- 
tiveness in guiding pupils inthe learning-teaching 


* The author wishes to express his thanks to Professor A. S. Barr, who served as his major pro fessor, 
and to Professors L. E. Drake and T. A. Ringness, bothof whom servedonthe author’s thesis committee. 


** All footnotes will be found at end of article. 
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situation. The study here reported purports to 
explore the influence of certain personality ab- 
normalities as measured by supervisory ratings. 

It is expected that this study will discover such 
relationships as may exist between teacher effec- 
tiveness as measured by supervisory ratings and 
scores on the MMPI. 


SECTION II 


The Procedures Used in the Investigation 


Design of the Study 


The study here reported attempts to compare 
the ratings of teachers who were rated outstand- 
ing, above average, average, below average, or 
poor by their principals or superintendents, with 
scores on the MMPI. 


The Minnesota Multiphasic Personality 
Inventory 


The MMPI is a psychometric instrument devel- 
oped at the University of Minnesota byS. R. 
Hathaway, Professor andDirector of the Division 
of Clinical Psychology at the University of Minne- 
sota, and J. C. McKinley (deceased), formerly 
head of the Department of Neuropsychiatry at the 


University of Minnesota. The Inventory was de- 
signed to provide scores on all of the more im- 
portant clinical phases of personality. Although 
it was standardizedon 1500 normal individuals and 
220 psychopathic patients inthe University of Min- 
nesota Hospital and was designed primarily as a 
clinical instrument, it has been used very exten- 
sively in a great variety of experiments of a non- 
clinical sort. Albert Ellis5, in the Fifth Mental 
Measurements Yearbook§, says, “‘It can confi- 
dently be stated that in the whole history of mod- 
ern psychology there has been no other personal- 
ity inventory on which so much theoretical and 
practical work has been done.’’ The Fifth Mental 
Measurements Yearbook lists 495 studies about 
or withthe MMPI. Accordingly, including those 
listed in previous yearbooks, there has been a total 
of 779 studies through 1958, relating to this par- 
ticular instrument. Most of the early research 
on the Inventory was done in a hospital setting, 
but later research was conducted with normal per- 
sons and in relation to various situations. Drake 
and Oetting? state that ‘‘...almost all the pub- 
lished work has reported studies of the individual 
scales. While information about the individual 
scales may be useful in some instances, the be- 
havior that the counselor is try ing to understand 
or predict is usually too complex to be measured 
by a single scale.’’ Accordingly, attention has 
been shifted to patterns of scales as well as indi- 
vidual scales. 


The group form of the MMPI consists of 566 
statements covering awide range of subject mat- 
ter, from physical condition of the individual be- 
ing tested to his morale and attitude’. In admin- 
istering the test, the subject is asked to respond 
to all statements which are in the first person, as 
True, False, or Don’t Know. An IBM machine- 
scoring answer sheet has been adapted for this 
Inventory by Professor L. E. Drake of the Uni- 
versity of Wisconsin Student C ounseling Center, 
which has greatly facilitated the scoring opera- 
tions. 

The Inventory scales, of which there are ten 
plus four correctionscores, were developed ser- 
ially from 1942 to 1951. This probably accounts 
for the fact that mest ofthe earlier research with 
the MMPI has been with individual scales rather 
than profiles. 


Data-Gathering Procedures and 
Subjects of the Study 


The MMPI was administered to entering fresh- 
men during freshman orientation week at the Un- 
iversity of Wisconsin. The scoring was done by 
the University of Wisconsin Student Counseling 
Center. Personality profiles for the subjects of 
this study were obtained from these score cards. 

A list of all students who received the Univer- 
sity Teachers’ Certificate along with the teaching 
fields of these students was secured from the files 
of the Office of the Dean ofthe University of Wis- 
consin School of Education. The teaching posi- 
tions held by the subjects were obtained from the 
files of the University Teachers’ Placement Of- 
fice, the University Alumni Office files, and from 
the official directories ofthe public schools of the 
state of Wisconsin. 

Letters were sent to all known principals and 
superintendents of teachers in the study asking 
their cooperation in rating the teachers involved. 
The rating blank asked for comments regarding 
elements of strength in the teacher’s work, the 
elements of weakness inthe teacher’s work, gen- 
eral comments, and an overall rating on a five- 
point scale. 

Tabulations ofthe ratings, comments, and pat- 
terns of personality scores were then made and 
relationships among the various data sought. 

The subjects for this study consisted of all the 
students enrolled at the University of Wisconsin 
during the fall semesters of 1949, 1950, and 1951, 
who receivedthe University Teachers’ Certificate 
in 1953, 1954, 1955, or 1956, and who have taught 
in the public schools of Wisconsin. It was found 
that a total of 431 students from the freshman 
classes of 1949, 1950, and 1951 had taken the 
MMPI, had graduated inthe years 1953-56, and 
had received the University Teachers’ Certificate. 
Due to the Korean situation and other matters, 
many of the males who had originally enrolled did 
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not graduate and many more who did graduate did 
not go into teaching. Marriage and decisions not 
to teach removed many of the females from the 
list of teachers. For others, no record of post- 
graduation activity could be found. In somé cases, 
due to the death of a principal or superintendent, 
or to his moving to an unknown location, it was 
impossible to get a supervisory rating on a par- 
ticular teacher. In afew cases the administra- 
tors and supervisors failed to supply the ratings. 
The number of teachers for whom complete data 
were secured was 167, of which only 20 were 
males. 

Although this is not intended to be a sampling 
study, there appears to be no reason to believe 
that the people here studied were greatly different 
from other people who graduate from the Univer- 
sity of Wisconsin Schoolof Education. Since this 
is a very limited population, users of the data in 
this study may be interested to know more about 
the group. Considering the group of 167 as a unit, 
this population was different from the usual in that 
only twenty were males. For this reason, and 
because highor low scores on many of the MMPI 
scales mean different things for men and women, 
the female po pu lation of 147 was studied separ- 
ately. Of this group, nine were music teachers; 
twelve, teachers of art; thirteen, speech correc- 
tion; fifteen, phy sical education and recreation; 
thirty-three, home economics; six, business ed- 
ucation; fifteen, elementary; eight, social studies; 
one, mathematics and science; and thirty-five, 
English, foreigh language, speech or library. All 
had grade-point averages of 2.5 or better at the 
beginning of their junior year. In general, they 
appeared to be a typical University of Wisconsin 
School of Education group. Assuming there has 
not been much change in the basic characteristics 
of University of Wisconsin students, the interested 
reader is referredto Lins? study for detailed in- 
formation concerning a ty pical university group 
of women students. 

Whenever it was possible, which was in more 
than half the cases, twoor more ratings were se- 
cured on each teacher. Whenthese ratings did 
not agree, they were averaged and the average 
rating used. When ratings differed, they differed 
by only one rank. 

Of the 147 women, ten were rated outstanding 
or 1; eight had a mean rating of 1.5; sixty-one 
were rated above average or 2; fourteen hada 
mean rating of 2.5; forty-two were rated average 
or 3; three had an average rating of 3.5; seven 
teachers were rated below average or 4; and two 
were rated poor or 5. Either most of the teach- 
ers in this study were above average or super- 
visors and principals have a tendency to overrate 
their teachers. Because the frequencies in some 
of the categories were rather small, they were 
combined as follows: eighteenteachers inthe 1 or 
1.5 rating group, seventy-five cases in the 2 or 


2.5 rating category, forty-five in 3 or 3.5, and 
nine cases in the 4 or 5 rating group. 


Coding the Data 


The scores on the MMPI had been coded ac- 
cording to the method of Hathaway. 10 The scales 
were assigned numbers as follows: 


Social Introversion-Extroversion 
Hy pochondriasis 

Depression 

Hysteria 

Psychopathic Deviate 
Masculinity- Femininity 

Paranoid 

Psychasthenia 

Schizophrenia 

Hypomania 


Raw scores had first been converted to stand- 
ard T scores. (T scores have a mean of 50 and 
a standard deviation of 10). In the coding, the 
number of the scale with the highest T score was 
written first, then the second highest, and so on 
down. No score which fell within half a standard 
deviation on either side of the meanwas record- 
ed. This means that only scores of 55 or above 
were coded high. After the high scores had been 
listed according to the number of their scales, a 
dash separated the low scored scales. These 
were listed by scale number withthe lowest scored 
scale first, the next lowest second, and so on. 
No score above 45 was coded low. Tied scores 
were underlined. Thus, ifa person’s profile code 
is 3987-645, it means that the highest score was 
made on scale 3, the score on scale 9 was equal 
to that on 3 ordiffered by only one point, the next 
highest score was on scale 8, and the next on 
scale 7. Scores of 55 or above were made on all 
of these scales. The lowest score was made on 
scale 6, the next lowest on scale 4, and the next 
on scale 5. The scoresonthesethree scales were 
all below 46. Scores on the remaining scales (0, 
1, and 2) were withinthe normalor average range. 

This system of coding has been recommended 
because it expresses both intensity and pattern 
and at the same time effects a compromise be- 
tween too much detail on scale elevation and equal- 
ly undesirable detail as to profile shape!!. 
Du Mas12) in discussing problems of profile an- 
alysis concludes, ‘‘If predictionor diagnosis isto 
be maximally good, both intensity and pattern 
must be operative in a profile. ’’ 


Methods of Analyzing the Data 


There are many theories of mental structure, 
organization, and techniques for the validation of 
data-gathering devices with reference to these. 
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The conventional statistical techniques for test 
validation appear to rest upon the assumption of 
the additive nature of the constituents of human 
abilities and personalities. This study does not 
make this assumption and, accordingly, a differ- 
ent technique of validation has been employed. 

It is thought by many researchers in personal- 
ity that patterns of personality traits, the ways 
in which various phases go together, are the im- 
portant determiners of personality manifestations. 
In some cases one scale reinforces another, while 
in others one scale com pensates for or offsets 
another. Forcertain scales extreme scores 
seem to be the only important ones. The most 
promising recent research, especially that of S. 
R. Hathaway and L. E. Drake, has been conduct- 
ed with reference to these ideas. 

In the present study, comparisons were made 
between supervisory ratings and highest ranking 
scales, combinations of high ranking scales, and 
combinations of high scales and low scales. It is 
hy pothesized that personality profiles on the 
MMPI are different for highly rated teachers than 
for teachers who are ratedlower. McCalll3 found 
a relatively close relationship between teacher 
personality and pupils’ comprehensive growth as 
measured in his investigation. 

Various procedures were employed in analyz- 
ing the data. Among these was the chi-square. 
When a chi-square large enough to be encourag- 
ing was found, the data were examined more 
closely and other tests were made to see if a re- 
lationship between a particular rating and a scale 
or profile pattern might be more firmly estab- 
lished. Since in most cases the chi-square sta- 
tistic was usedtotest whether having a particular 
scale or combination coded in a certain manner 
or not having it coded thus was statistically sig- 
nificant in regard to supervisory ratings, the ex- 
pected frequency of each cell becomes a matter 
of interest. 

Inasmuch as there are forty cells ina 4 x 10 
table which was employed inthe overall chi-square 
analysis, the expected frequencies for 147 cases 
would naturally not be large. In many instances, 
they fell below the minimum of five or ten fre- 
quently thought necessary for such analyses. 

Under the null hy pothesis it is assumed that 
having a particular personality trait has no rela- 
tionship to supervisory ratings. For example, 
as shown in Table I, twenty-four female teachers 
had scale 3 (Hy) coded highest of all the scales. 
Under the null hypothesis, one would expect these 
twenty-four cases to be distributed among the su- 
pervisory ratings proportionately to the way in 
which the total 147 cases are distributed among 
the supervisory ratings. Seventy-five of the 147 
teachers were ratedinthe second category. Then 
the expected frequency for the cell designating 
scale 3 coded highest and supervisory rating of 
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2-2.5 would be that part oftwenty-four that 
seventy-five is of 147. This is 12. 24. 

In this use of chi-square, the data are put into 
various categories (e. g., the dichotomy of having 
a scale coded high or not high on one hand and the 
four-fold categorization of supervisory ratings 
on the other). These categories should not be in- 
terpreted as points on a scale. 

Chi-square is a measure of the amount that 
observed frequencies differ from expected fre- 
quencies in the various categories. In this study 
most of the observed frequencies were about what 
one would expect. This is indicated by the chi- 
square values, only a few of which were large 
enough to be statistically significant. 

Tate and Clelland!4 say, ‘‘The test (chi-square) 
is the best available for enumeration data from a 
manifold population. It gives good results even 
when the expected frequency in one or more cat- 
egories is as low as one, provided that the ma- 
jority are about five or more.’’ Not all authors 
agree with Tate and Clelland’s statement regard- 
ing the use of chi-square and particularly the 
minimum number required for expected frequen- 
cies. Sincethe number in each category is rather 
small in some cases (after the data are broken 
down into sub-categories) chi-squares have been 
figured in several instances where the statistical 
significance of the result must be seriously ques- 
tioned. Many authors dol5,16,17, however, in- 
dicate that the heretofore commonly accepted min- 
imum expected frequency of five per cell is too 
high, especially when there are two or more de- 
grees of freedom. In this study there are three 
degrees of freedom for most of the chi-square 
tests. 

In addition to the chi-square tests, the per- 
centages of occurrence of the various patterns of 
high and low scores were calculated for each of 
the four rating categories. It was thought that 
such data would enable one to make certain qual- 
itative analyses of profile patterns in relation to 
the supervisory rating. The following profile 
patterns were compared: 


1. The frequency with which each scale of the 
three highest scales occurred with every 
other scale coded high (above T = 54). 

2. The frequency with which each scale of the 
three highest scales appeared with each of 
the two lowest scales. This was done for 
each of the four rating categories. 

3. The frequency with which each scale coded 
anywhere high (above T = §4) occurred with 
each scale coded anywhere low (below T = 
46). This was done for the highest rated 
group. 


The data obtained inthese comparisons are shown 
in the tables reproduced in Section III. 
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SECTION III 


The Analysis of Data 


The purpose of this study, as stated in Section 
I, is to explore the relationship between scores 
and profile patterns on the MMPI and success in 
teaching as indicated by supervisory ratings. The 
study isdesignedto discover whether or not there 
are differences in the personality patterns of suc- 
cessful and unsuccessful teachers. 

In order to carry out the stated purposes of 
this study, it was necessary to submit the data to 
certain statistical analyses which will be ex- 
plained. Thedatain this study are nonparametric 
in nature and, consequently, any statistical meas- 
ures employed should be of the nonparametric 
type. The methods of securing the supervisory 
ratings and of grouping them into four categories 
were explained in Section II, as was the method 
of coding the scores from the MMPI. 


The Female Teachers 


The following discussion is in reference to the 
group of 147 female teachers only. 

The frequency with whicheach scale was coded 
highest or tied for highest for each of the four su- 
pervisory rating categories was first tabulated 
(Table I). Because of the low frequencies in some 
of the categories certain planned techniques had 
to be abandoned. However, chi-squares were 
figured for cases which had a total N of ll or 
more. Whenever the chi-square value was large 
enough to suggest some relationship, closer ex- 
amination of the data were made. In most cases 
chi-square values were calculatedusing a method 
advocated by Lindquist!8 which is less time con- 
suming than the traditional method, but which is 
the algebraic equivalent of the traditional. 19 

Only one group—the group with scale 3 (Hy) 
coded highest—seemed worthy of further investi- 
gation. A chi-square of 7. 934 with three degrees 
of freedom was found for this group, indicating 
that having scale 3 (Hy) coded highest might dis- 
criminate among the female teachers in the var- 
ious rating categories. With three degrees of 
freedom, a chi-square of 7. 934 is significant be- 
yond the 5 percent level. 

For the group with scale 3 coded highest, the 
expected frequencies for each rating, under the 
null hypothesis of no difference, were 2.94, 12.24, 
7.35, and 1. 47 for ratings of 1 - 1.5, 2 - 2.5, 
3- 5.5, and 4-5, respectively. A comparison 
of the expected frequencies withthe observed fre- 
quencies indicated that the greatest discrepancy 
was for the 1 - 1.5 rating. It was then hypothe- 
sized that being rated high, i.e., 1 or 1.5 was re- 
lated to having scale 3 coded highest of all the 
scales. The datawere arranged in a 2 x 2 contin- 
gency table, Yates’ correction29 for small expect - 


ed trequencies applied, and chi-square calculated. 
The value found was 5. 871 (see Table IX). With 
one degree of freedom, this value of chi-square 
is significant beyond the 2 percent level. Exam- 
ination of the data showed the relationship to be 
positive. 

For these data at least, there seems to be a 
potential relationship for female teachers between 
the occurrence of scale 3 (Hy) being coded high- 
est and asupervisory rating of outstanding. Much 
larger groups of teachers including many who 
have been rated outstanding are needed to estab- 
lish this relationship firmly. 

Continued explorationof various relationships 
among the data tabulated as indicated above failed 
to reveal additional statistical significant rela- 
tionships. However, an examination of the rela- 
tive frequencies in the various categories did 
bring out some interesting relationships which 
will be pointed out. Although only eleven cases 
out of the total 147 female teachers had scale 
0 (Si) coded highest, only two of these received 
supervisory ratings of average or less. It would 
appear that anabsenceof scale 0 (Si) coded high- 
est may be associated with average or below av- 
erage supervisory ratings. 

However, when one considers the small num- 
ber (eleven) in the group, it is apparent that this 
may be a false conclusion. When the group is en- 
larged to include all those who had scale 0 (Si) 
coded among the three highest scales (see Table 
II), the number is increased to thirty-one and the 
number receiving ratings of average or belowis 
increased to thirteen, whichis more than the ex- 
pected frequency. This would seem to dispute the 
conclusion of relationship betweena lack of scale 
0 (Si) being coded high and average or below av- 
erage supervisory ratings. 

The above is anexample of afact that has been 
obvious throughout the analysis of the data in this 
study, namely, that for studies of this nature 
very large groups, preferably in the thousands 
rather than the hundreds, are highly desirable. 
Whereas normally a much smaller group is am- 
ple for a good investigation, studies of this kind 
necessitate a group large enough to provide suf- 
ficient cases in each of the sub-groups after the 
data have been broken down. 

A similar examination of the group with scale 
7 (Pt) coded highest indicates a possible slight re- 
lationship between scale 7 (Pt) coded highest and 
average or below supervisory ratings. When the 
relationship between scale 7 (Pt) being coded 
among the three highest and supervisory ratings 
is investigated, support is gained for this possi- 
bility, since the chi-square for this relationship 
is 5. 254 (about the 16 percent level). Although 
the evidence is not statistically significant at the 
commonly designated 5 percent level, analysis of 
the data for this study seems to give some indi- 
cation that high codings of scale 7 (Pt) are not 
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associated with high supervisory ratings for wom- 
en teachers, but that low codings of scale 7 are 
associated with average or below supervisory 
ratings for womenteachers (see Tables III, IV,VII 
and IX). The codetype 7 - 5 (high coding of sev- 
en with low coding of 5) was a common one for 
women teachers in boththe above average and av- 
erage or below rated groups, the evidence again 
favoring the lower ratedteachers. Superior teach- 
ers did not, in general, make their highest MMPI 
scores on scale 7 (see Tables I and II). 

Further examination of the data revealed a pos-,; 
sible meaningful relationship between scale 5 (Mf) 
coded among the three highest and supervisory 
ratings. The chi-square value indicating the re- 
lationship was 5. 761 (about the 13 percent level). 
This was high enough to merit further investiga- 
tion (see Table II). 

The number inthe groupwhich had scale 5 (Mf) 
coded among the three highest was 29. The ex- 
pected frequencies for the four supervisory ratings 
from 1 to 5 were, respectively, 3.55, 14. 80, 
8.88, and 1.78. The largest discrepancy between 
expected and observed frequencies was for the 
group with ratings of 2o0r 2.5. When the chi- 
square test was applied to the re-grouped data to 
test whether scale 5 being coded among the three 
highest might be related to a 2 or 2.5 rating, a 
value of 4. 65 was obtained. If Yates’ correction 
for small expected frequencies is applied, the 
calculated chi-square value is 3.80 (see Table IX). 
With one degree of freedom, 3.80 just misses be- 
ing significant at the 5 percent level. 

The data for this same group were then ar- 
ranged in a 2 x 2 contingency table to test whether 
having scale 5 (Mf) coded among the three highest 
scores might be related to ratings anywhere 
above average, that is, from 1 through 2.5. With 
this arrangement, Yates’ correction was unnec- 
essary since the expected frequencies in each cell 
were above ten. This time a chi-square of 4. 00 
was found (see Table VII). This is significant be- 
yond the 5 percent level, indicating that for the 
group of womenteachers inthis study, a high cod- 
ing of scale 5 is positively related to above aver- 
age or outstanding supervisory ratings. There is 
some indication that the rating is more apt to be 
2 or 2.5 than 1 or 1.5. 

There is some indication that a low coding of 
scale 5 (Mf) for the womenteachers is associated 
with average or below average supervisory 
ratings (see Tables III, IV, VII, and VIM). 

A comparison of the frequencies of various 
combinations of high and low coded scales for the 
‘‘above’’ and ‘‘below’’ rated teachers did not in- 
dicate any statistically significant differences. 
The number in most categories was too small to 


be dependable (see Table VIII). An examination 
of the data, however, shows that for every code 
type with 5 low (0-5, 1-5, 2-5, 3-5, etc.,) 
the expected frequency is larger thanthe observed 
frequency for the average or below average gi oup. 

Since scale 5 coded low has been found to be 
either a suppressor or an intensifier factor with 
high codings of other scales21, chi-square tests 
were run to see if a low coding of scale 5 witha 
high coding of each of the other scales differenti- 
ated between supervisory ratings above average 
and those below that. For the group of women 
teachers studied, no sigificant differences in su- 
pervisory ratings were found within the group 
with a particular scale coded high in respect to 
having scale 5 coded low or not coded low. Data 
for this analysis can be found in Table VI. 

A low coding of scale 2 (D) was associated with 
the group of women teachers studied with above 
average or outstanding supervisory ratings (see 
Tables III, IV, and VII). When the supervisory 
ratings were divided into a dichotomy, a chi- 
square value at the 5 percent level was calculat- 
ed (see Table VII). Drake22 says that a low cdd- 
ing of scale 2 for women is frequently related to 
‘‘socially outgoing characteristics’’. 

The proportion of the number in each super- 
visory rating category who had the various scales 
coded highest or among the highest was also cal- 
culated and recorded as a percent (see Appendix 
B, Tables A and B).* Tabulations of other com- 
binations were also made (see Appendix B, Tables 
C, D, and E). While some of the relationships 
shown in these tables may be of some interest, 
none of these supplementary tables indicate any- 
thing of statistical significance. 


The Male Teachers 


The number of male teachers in the group 
studied was so small (twenty) that little could be 
done of a statistical nature. Whenthe available 
data were brokendown into the necessary sub- 
groups, the number in each group was usually 
zero or one and seldom more than two. Descrip- 
tive statements concerning this group of male 
teachers will be made as far as seems appro- 
priate. 

Two of the twenty men inthe group received 
supervisory ratings of 1.5; thirteen of the group 
were rated 2; one was rated 2.5, and four were 
rated 3. Thus, sixteen of the twenty men in the 
group were rated above average or outstanding by 
their supervisors or principals. The other four 
were rated average. With numbers this small, 
any statements of relationships between super- 
visory ratings and MMPI code types could not be 


*All references to Appendices will be found in original thesis on file, Library, University of Wisconsin, 
Madison, Wisconsin. 
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TABLE V 


FREQUENCY OF SUPERVISORY RATINGS OF FEMALE TEACHERS WHO HAD VARIOUS PAIRS 
OF MMPI SCALES CODED AMONG THE THREE HIGHEST 


Pairs of Scales 
Among the 
Three Highest : - 2.5 3- 3.5 


Supervisory Rating 


75 45 


1 1 1 0 
1 3 4 0 
2 (2. 57)* 9 (10. 71) 8 (6. 43) 2 (1. 29) 1.379 
0 (1. 35) 7 ( 5.61) 4 (3. 37) 0 (0. 67) 2. 683 
0 0 2 0 


0 0 0 0 


0 0 1 0 
0 0 0 0 
2 (1. 84) 6 ( 7. 65) 5 (4. 59) 2 (0. 92) 


1 6 2 0 


iF 
ON = is 9 ‘DF. =3 
a 01 4 1 1 2 0 
02 5 1 1 2 1 
03 1 1 4 1 1 
04 4 1 3 0 0 
05 3 
be 06 8 | 
07 21 
08 11 
09 2 
12 1 0 1 0 
2 13 8 2 4 2 0 

a 14 3 0 1 2 0 
15 1 0 1 0 0 
16 2 0 2 0 0 
‘ 17 4 0 3 1 0 

a 18 1 0 1 0 0 
te 19 5 1 3 1 0 ; 
| 2 Ix 0 0 0 0 0 

: 23 4 0 3 1 0 

24 5 1 4 0 0 | 
a 25 1 0 1 0 0 

26 2 0 1 0 
me 27 10 0 5 3 2 ) 
28 5 0 3 1 

29 1 
34 15 1. 873 alg 
35 9 
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TABLE V (Continued) 


Pairs of Scales 
Among the 
Three Highest 1-11.35 2- 2.5 


= 147 18 75 


Supervisory Rating 


36 19 2 (2. 33) 10 ( 9. 69) ; 6 (5. 82) 
37 li . 35) . 61) . 37) 
38 6 
39 15 - 
3X 5 
45 5 
46 11 
47 20 
48 10 
49 

4x 

56 

57 

58 

59 

5X 

67 

68 

69 

6X 

78 

79 

7X 

89 

8X 


9X 


*Number in parentheses following observed frequency is expected frequency for that cell. 


3= 3.5 4-5 Square 
45 D.F. = 3 ae 
1 (1. 16) 097 | 
3 (0. 67) 10. 772 
1 (0. 92) 1. 267 
0 
0 (0. 67) 1.271 
1 (1, 22) 1.257 eM 
0 
0 (0. 98) 1. 749 i 
0 
0 
0 
0 (0. 67) 499 
0 
0 (1. 16) 2. 387 
0 (0. 67) 1.271 
Z| 
|| 3 (1. 90) 2. 032 ote 
1 (0. 92) 782 
> 1 (0. 80) 459 
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TABLE VI 


FREQUENCIES OF PRESENCE OR ABSENCE OF LOW CODING OF SCALE 
5(Mf) WITH HIGH CODING OF OTHER SCALES FOR FEMALE TEACHERS 
WITH ABOVE AVERAGE OR SUPERIOR AND AVERAGE OR BELOW 
SUPERVISORY RATINGS 


Supervisory Rating 


Code Type* Chi-Square 
High - Low N = 93 = D. F. =1 


7 


9 - Not 5 24 


*High coded scale was among the three highest; 5, when coded low 
was among the two lowest. : 


341 

0-5 6 7 

ee 0 - Not 5 12 6 1. 304 t. 
a 3-5 8 7 
ba 3 - Not 5 26 13 826 | 
a 4 - Not 5 20 7 1. 667 

6-5 12 7 
“ 6 - Not 5 16 10 001 
a 7-5 16 15 

7 - Not 5 20 11 1. 060 

ie 8 - Not 5 17 1 1. 046 
9-5 7 

10 1. 838 
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TABLE VII 


COMPARISON OF FREQUENCY OF OCCURRENCE OF CERTAIN CODE TYPES FOR 
FEMALE TEACHERS WHO WERE RATED ABOVE AVERAGE OR SUPERIOR WITH 
THOSE WHO WERE RATED AVERAGE OR BELOW AVERAGE 


Supervisory Rating 


1-2.5 Chi-Square 
Code Type N = 93 


highest 9 ( 6. 96)* 
18 (15. 
6 ( 6. 
14 (11. 


among 3 highest 


among 2 lowest 


2 
5 
7 
9 


07 among 3 highest 


34 among 3 highest 


* Numbers following observed frequencies are expected frequencies. 


**Chi-square for 7 coded lowest was reduced to 2. 715 when Yates’ correction was 
applied. 


by} 
0 2 ( 4.04) 1. 760 
4 3 6 ( 8. 82) 1. 704 ran 
4 5 ( 4.04) . 556 

5 4 ( 6.61) 1. 869 
6 11 (11. 39) 7 ( 6.61) 
7 17 (18. 98) 13 (11. 02) 107 
9 20 (18. 98) 13 (11. 02) . 188 
ey 0 18 (19. 61) 13 (11. 39) . 460 Bu 
1 10 ( 8. 86) 4 ( 5.14) . 442 
oe a 2 10 (10. 12) 6 ( 5. 88) ne 
Ra 3 34 (34. 16) 20 (19. 84) ats 
i 4 30 (28. 47) 15 (16. 53) . 323 Feit 
ao 5 23 (18. 35) 6 (10. 65) 4. 002 oy 
oe. 6 28 (28. 47) 17 (16. 53) 2. 
Lay 7 36 (39. 22) 26 (22. 78) 1. 245 fe 
if 8 27 (26. 57) 15 (15. 43) ee 
a 3 31 (30. 37) 17 (17. 63) “Te 
na 0 lowest 16 (13. 28) 5 ( 7.72) 1. 761 4a 
vt 2 13 (10. 12) 3 ( 5. 88) 2. 499 31 
a! 5 21 (25. 94) 20 (15. 06) 3. 550 44 
7 5 ( 8. 22) 8 ( 4. 78) 3. T75** 
ne 9 8 ( 6. 96) 3 ( 4. 04) . 458 mS 
bes Co 25 (20. 25) 7 (11. 75) 3. 886 ee. 
ay 27 (31. 63) 23 (18. 37) 2. 799 oe 
16 (17. 09) 11 ( 9.91) 228 
ae 17 (14. 55) 6 ( 8. 45) 1. 330 Pe: 
11 (13. 28) 10 ( 7. 72) 1. 249 
8 ( 9. 49) 7 ( 5. 51) 109 | 
i 37 6 ( 6. 96) 5 ( 4.04) . 389 as 
<u 49 12 (10. 12) 4 ( 5.88) 1. 066 2) 
67 11 (12. 02) 8 ( 6. 98) 271 
$35, 78 19 (19. 62) 12 (11. 38) © . 066 are 
89 9 ( 8. 23) 4 ( 4.77) 215 
i 


FLANAGAN 


TABLE VIII 


COMPARISON OF FEMALE TEACHERS RATED ABOVE AVERAGE OR SUPERIOR WITH THOSE 
RATED AVERAGE OR BELOW AS TO COMBINATIONS OF HIGH AND LOW CODED SCALES 


Code Type Above Frequency Below Frequency Chi-Square 
High with Low Observed (Expected) Observed (Expected) D.F. =1 


( 3. 80) ( 2. 20) 


( 5. 06) ( 2.94) 


( 8. 23) ( 4. 77) 


' 


96) 
.53) 


4 
3 
5 
1 
6 
2 
0 
0 
7 
3 
1 
3 
0 
2 
2 
1 
1 
0 
3 
2 
2 
0 
0 
0 
3 
1 
0 


AD OM 


UK 
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14 || 
14 1. 8064 | 

( | ( 4.04) 
(2 ( 1.47) PA 
( 2.53) ( 1.47) 
ae ( 4. 43) ( 2.57) 

ee 1 (12. 65) ( 7. 35) 6779 | 
tae ( 3. 16) ( 1. 84) 
( 5. 06) ( 2. 94) | 
( 9. 49) ( 5.51) 7092 
( 8. 23) ( 4.77) 5495 
4. 43) ( 2.57) 
oh 6. 33) ( 3. 67) 

( 5. 06) ( 2.94) 
( 6. 96) ( 4. 04) 
i ( 3. 80) ( 2. 20) | 
( 3. 16) ( 1. 84) 
(11. 39) ( 6.61) 
aa ( 5. 06) ( 2. 94) 

i ( 6. 33) ( 3.67) 2881 

( 5. 06) ( 2. 94) 
4 ( 6. 96) ( 4.04) 

( 6. 96) ( 4. 04) 4561 
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TABLE VIII (Continued) 


Code Type Above Frequency Below Frequency Chi-Square 
High with Low Observed (Expected) Observed (Expected) D.F. =1 


OM OO 
NONUNANALAE ON 


DAMM nw 


' 


' 
COIR 


COP OP KF WwW 


7 
7 
7 
7 
7 
7 
7 
7 
8 
8 
8 
8 
8 
8 
8 
8 
8 
8 
9 
9 
9 
9 
9 
9 
9 
9 
9 
xX 
Xx 
x 
x 
Xx 
X 


Note: Number rated above average - 93 (63. 27%) 
Number rated average or below - 54 (36. 73%) 


High coded scale was among the three highest. 
Low coded scale was among the two lowest. 


344 
= 
( 3.31) 
( 2.94) 
( 6. 98) 
( 4.04) . 4561 
( 3.67) 1. 2881 
Af (11. 39) 2. 2922 
Gt ( 3. 67) 
34 ( 2.57) 
~ 
( 6. 61) 5264 
( 6. 61) . 5264 
( 4.04) 
( 5.14) 4415 
| 
( 5.14) 1. 1755 
( 5.14) 1.1755 
( 2.94) 
| 
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TABLE Ix 


FREQUENCY RELATIONSHIPS AMONG MISCELLANEOUS CODE TYPES AND SUPERVISORY 
RATING CATEGORIES FOR FEMALE TEACHERS 


Code Type 


highest 


3 not highest 


highest 


not highest 


3 among 3 highest 


not among highest 


among 3 highest 


7 not among highest 


8 among 3 highest 


8 not among highest 


47 among 3 highest 


47 not among highest 


78 among 3 highest 


78 not among highest 


7 among 2 lowest 


7 not among lowest 


5 among 3 highest 


5 not among highest 


5 lowest 


5 not lowest 


7 among 3 highest 


7 not among highest 


7 among 2 lowest 


7 not among lowest 


0 


9 


— 


Below 1.5 


9 


63 


___Not 3 - 3.5 


Chi-Square 


. 871 with Yates’ Correction 


. 349 
. 479 with Yates’ Correction 


. 648 
80 with Yates’ Correction 


345 

1-1.5 D.F. =1 
4 
1 29 ‘ 
17 100 2. 786 
4 84 1. 556 as 

3 

3 39 
15 90 1. 424 

1 19 
17 110 1.131 
jt 
2 29 

16 100 1.227 
5 22 

13 107 1.211 
20 
4 
55 = 

17 24 

28 78 3. 152 
4-5 Not 4-5 

6 56 

3 82 2. 349 
27 
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TABLE X 


FREQUENCY OF SUPERVISORY RATINGS OF MALE TEACHERS WHO HAD VARIOUS 
MMPI SCALES CODED HIGHEST OR TIED FOR HIGHEST 


Scale Coded High- Rating 


est or Tied for 
Highest 


0 0 


1 0 


TABLE XI 


FREQUENCY OF SUPERVISORY RATINGS OF MALE TEACHERS WHO HAD VARIOUS 
MMPI SCALES CODED AMONG THE THREE HIGHEST 


Scale Coded 
Righest . 3. Total 


Supervisory Rating 


0 2 
1 3 
2 


3 


346 
1.5 2. 2.5 3. Total 
N=2 N=13 N=1 N=4 N = 20 
0 0 0 0 
, Be 
2 0 1 0 0 1 
$ 3 0 2 0 0 2 be, 
vu 4 0 0 0 1 1 ata 
aa 5 2 5 0 2 9 oe, 
wa 6 1 2 0 0 3 i 
€ 8 0 0 0 0 0 nae 
1 5 1 0 7 
oi 4 0 2 0 2 4 i 
2 7 2 2 13 
6 1 4 0 0 5 
pe) 7 1 3 0 2 6 cS 
1 4 1 1 7 
9 1 1 1 1 4 
x 0 0 0 
id 
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TABLE XII 


FREQUENCY OF SUPERVISORY RATINGS OF MALE TEACHERS WHO HAD VARIOUS 
MMPI SCALES CODED LOWEST OR TIED FOR LOWEST 


Scale Coded Low- 
est or Tied for = 
Lowest 2.5 Total 


____ Supervisory Rating 


TABLE XIII 


FREQUENCY OF SUPERVISORY RATINGS OF MALE TEACHERS WHO HAD VARIOUS 
MMPI SCALES CODED AMONG THE TWO LOWEST 


Scale Coded Supervisory Rating 
Among the Two 
Lowest 2 2.5 


0 


347 
0 1 2 0 0 3 
1 0 1 0 1 2 
2 0 0 0 1 1 
3 0 1 0 0 1 
4 0 0 0 1 
5 0 0 0 1 1 
af : 6 0 1 0 0 1 
a 1 0 2 0 0 2 
3A 8 0 2 0 0 2 KS 
a 9 0 1 0 0 1 
@ x 1 2 1 1 5 ; 
4 
3 
1 5 0 1 7 
0 5 0 6 
2 0 1 0 0 
. 3 0 1 0 0 1 
a 4 1 3 0 0 4 
ms 5 0 1 0 1 2 | 
> 6 0 0 0 0 0 
: 7 0 4 0 0 4 
8 0 5 0 0 5 
a 9 0 2 0 0 2 ' 
x 1 2 1 1 5 
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TABLE XIV 


FREQUENCY OF SUPERVISORY RATINGS OF MALE TEACHERS WHO HAD VARIOUS PAIRS OF 
MMPI SCALES CODED AMONG THE THREE HIGHEST 


Pairs of Scales 
Coded Among the 
Three Highest ‘ 2 2.5 


Supervisory Rating 


01 

02 
03 
04 
05 

06 
07 
08 
09 

0x 
12 

13 
14 
15 

16 
17 
18 
19 
1X 
23 
24 
25 
26 
27 
28 
29 


2X 


3 
348 | | 
T tal 
; 
0 0 0 
| 
0 
| 
i 
| 
2 0 
| | 
dak, 0 i 
| 
0 
“al 
| 
2 
| 
4 1 1 
: 
4 0 0 
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TABLE XIV (Continued) 


Pairs of Scales 
Coded Among the 
Three Highest 


Supervisory Rating 


2 2.5 


34 


35 


36 


37 


349 

oe = 0 1 0 0 1 

1 2 1 0 4 
= 1 1 0 0 2 
0 0 0 0 0 
ne 38 0 0 0 0 0 |. 
39 1 1 1 0 0 
Be 3X 0 0 0 0 0 
a 45 0 0 0 1 1 

46 0 1 0 0 1 
47 0 1 0 1 2 
a: 48 0 0 0 0 0 | 
49 0 0 0 1 1 
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depended upon. The addition of one or two more 
cases could change the picture entirely in many 
of the categories. 

It can be noted that nine of the twenty men had 
scale 5 (Mf) coded highest of all the scales (see 
Table X), and thirteen of the twenty had scale 5 
coded among the three highest (Table XI). Only 
two men had a low coding of scale 5 (see Table 
XIII). Drake23 says, ‘‘Ahigh coding of this scale 
among men is particularly frequent in an educa- 
tional setting. ’’ 

No other scale was coded highest frequently 
enough to merit special attention. Scale 3 (Hy) 
was coded among the three highest seven times, 
all for above average teachers. Scale 7 (Pt) was 
coded among the three highest six times, two of 
these being for men who were rated average teach- 
ers. Scale 8 (Sc) was among the three _ highest 
scales seven times, distributed among the rating 
categories. 

No pair of scales was coded among the highest 
three scales frequently enough to warrant any 
generalizations concerning it (see Table XIV). 
Pairs 15, 25, 39, 56, and 78 appeared three times 
each. Pair 35 was coded among the three highest 
four times and 58 was coded among the three 
highest five times. Four of these times were for 
teachers with supervisory ratings of 2 and the 
other was for a teacher with a rating of 1. 5. 

Five of the twenty men in the group had no 
scales coded low (more than one standard devia- 
tion below the mean). These five appeared in all 
four of the supervisory rating categories (see Ta- 
ble XII). Three of the group had scale 0 (Si) coded 
lowest and two eachhad scales 1 (Hs), 7 (Pt), and 
8 (Sc) coded lowest. 

Six of the men had scale 0 (Si) coded among the 
two lowest scales. A low coding of scale 0 for 
men is ‘‘probably indicative of an adequate social 
adjustment. ’’24 Five each had scales 1 (Hs) and 
8 (Sc) coded among the two lowest. Four men 
each had scales 4(Pd) and 7 (Pt) coded among the 
two lowest. 

Because many of the sub-groups in this study 
(for both men andwomen) were very small, it was 
thought that Fisher’s exact probability test might 
be helpful. Siegel25 states, ‘‘The Fisher exact 
probability test is an ext remely useful nonpara- 
metric technique for analyzing discrete data 
(either nominal or ordinal) when the two inde- 
pendent groups are small insize and when the 
scores from the two groups fall into one or the 
other of two mutually exclusive classes.’’ The de- 
termining of the exact probabilities by means of 
Fisher’s formula is rather laborious, but many 
of the values may be obtained from a ‘‘Table of 
Critical Values of Dinthe Fisher- Yates Test. ’’26 
The Fisher test did not add any new information 
for this study; but it did support some of the pre- 
viously determined relationships. 


‘ 


Summary 


In summary, it can be stated that the analysis 
of the data for this study indicates the following 
relationships, —allofwhichare limitedto the pop- 
ulation studied or a similar group: 


1. A high coding of scale 3 (Hy) for women 
teachers'\was positively related to a supervisory 
rating of‘outstanding. Althougha statement of 
this relationship does not appear in any of tne lit- 
erature, Professor L. E. Drake, Head of the Stu- 
dent Counseling Center of the University of Wis- 
consin, has statedorally that in his experience he 
has found such a relationship to exist: 

Thirty-five percent of the small group of men 
in the study had scale 3 (Hy) coded among the three 
highest scales. All of these men were rated 
above average or outstanding by supervisors. 

2. Scale 7 (Pt), although coded highest or 
among the three highest scales for women teach- 
ers more frequently than any other scale, did not 
distinguish to a marked degree between good and 
poor teachers as indicated by supervisory ratings. 

An absence of scale 7 coded high seemed to be 
somewhat related to high supervisory ratings for 
women teachers. 

Low codings of scale 7 appeared to be positive- 
ly related to low supervisory ratings for women. 

Scale 7 was not coded highfor men as fre- 
quently, relatively speaking, as for women teach- 
ers. It was coded among the lowest two scales 
more frequently for men than were many of the 
other scales. 

3. For the womenteachers in this study, a 
high coding of scale 5 (Mf) was positively related 
to supervisory ratings which were above average, 
whereas a low coding of this scale seemed to be 
somewhat related to average or below supervis- 
ory ratings. There are some indications that more 
extensive data might reveal more definite rela- 
tions between high or low codings of scale 5 and 
supervisory ratings. It can be notedthat in the 
lowest rated group of female teachers, there is 
no occurrence of scale 5 coded high. 

For male teachers, scale 5 (Mf) coded highest 
appeared in 45 percent of the cases. It was coded 
among the three highest scales in 65 percent of 
the cases. Only one man had scale 5 coded among 
the two lowest scales. 

4. A lowcoding of scale 2 (D) for women teach- 
ers was associated with supervisory ratings that 
were above average. 

5. Scale 0 (Si) was coded lowest much more 
frequently than it was coded highest for women 
teachers. Alow coding seemed to be somewhat 
related to above average supervisory ratings. 

Scales 2 (D) and 5 (Mf) were also coded lowest 
more frequently than highest for women. 

6. There were only four out of 147 female 
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teachers who had no scales coded low, whereas 
five of the twenty male teachers had no scale 
coded low. 

It was pointed out in an earlier section that 
the MMPI was originally designed for and stand- 
ardized on mental patients, but that it has since 
been used advantageously onmany different more 
normal groups in a variety of situations. 

It should be pointed out that the people in this 
study, who were giventhe MMPI, were all Univer- 
sity of Wisconsin graduates who were granted a 
certificate to teach. The University of Wisconsin 
maintains an extensive testing, counseling, and 
guidance program and it is more than likely that 
most of the students with serious personality ab- 
normalities who were not eliminated through the 
natural processes associated with attending col- 
lege would be eliminated through the testing and 
counseling program. Atthe University of Wiscon- 
sin, students who deviate seriously fromthe nor - 
mal are sent to the University psychiatrist for 
counseling or treatment. 

Apparently the University of Wisconsin pro- 
gram is effective in eliminating the serious per- 
sonality cases before they are graduated and sent 
out to teach. For the 167 cases in this study, 
there were only two reports from supervisors or 
principals which were concerned with emotional 
instability which was serious enough to affect the 
teacher’s work. If the University’s program is 
successful, one would not expect the MMPI to dis- 
cover many extreme deviations from normality 
among the group in this study. 

The MMPI may be a valuable instrument in 
helping to eliminate the occasional seriously de- 
viated personality that does graduate and seek a 
teaching position. 

Further experimentation withthe MMPI is rec- 
ommended to see if there isn’t some ‘‘cut off’’ 
point on certain scales, possibly scales 0 (Si), 5 
(Mf), and 7 (Pt), or on combinations of scales, a 
score beyond which would eliminate a student from 
teacher candidacy. In order to findsuch points, 
especially if combinations of scales are to be con- 
sidered, it would probably be necessary to carry 
on a study of several years duration in order to 
get enough individuals in the study. 

One serious deficiency or fault is frequently 
enough to make a person unsuccessful. Success 
may be due to one or more superiorities, provid- 
ing a serious deficiency does not offset the super- 
ior qualities, or to a number of mediocrities. 

The various scales of the MMPI have been re- 
ferred to frequently by number or by number and 
abbreviation. It has been pointed out that the 
scales were first developed for clinical use with 
hospital patients and they bear titles indicative of 
deviate behavior. With the increased use of the 
Inventory for more normal people and further in- 
vestigation in regard tothe interpretation of scores 
on the various scales, the authors ofthe Inventory 


have suggested that the clinical titles and descrip- 
tions of the various scales should probably not be 
used. They suggest calling tne scales by number 
or letter. This has been done throughout this re- 
port. 

However, for those who are not familiar with 
the MMPI, brief descriptions ofthe various scales 
will be given. This will be done primarily in the 
language of Drake2’ who describes the scales in 
terms of the behavior of more normal persons. 

Scale 0 (Si) has thetitle ‘‘Social Introversion- 
Extroversion’’. This scale was derived and 
cross-validated by Drake28,29. Its title ismore 
or less self explanatory. The scale is intended 
to measure a characteristic that is thought to be 
important in college adjustment. Personality 
patterns with a high coding of scale 0 (Si) have 
been found among persons showing int rovertive 
characteristics, especially shyness, social inse- 
curity, and social withdrawal. One might expect 
such a personality characteristic to be detri- 
mental to teaching success. On the other hand, 
a low coding of scale 0 (Si), which is probably 
indicative of an adequate social adjustment, may 
indicate a higher degree of teacher effectiveness. 
The present study found low codings of scale 0 
(Si) for women teachers was associated with 
above average supervisory ratings. 

Scale 1 (Hy) bears the name ‘‘Hy poc hondri- 
asis’’. Elevationof this scale appeared relative- 
ly infrequently with college menand women, prob- 
ably because persons with problems of a nature 
which caused a high coding of this scale sought 
medical aid. A high coding of this scale ina 
teacher’s profile might indicate trouble which 
needs medical treatment. 

The ‘*Depression’’ scale has the number 2. A 
high score on scale 2 (D) is indicative of unhap- 
piness and depression. This condition may be 
associated with problems in the area of human 
relations, lack of success in a chosen endeavor, 
or dissatisfaction withsome aspect of the imme- 
diate environment. Scale 2 coded low with wom- 
en were related to extroversionor socially outgo- 
ing characteristics. The study here reported 
found low codings of scale 2 were associated with 
above average supervisory ratings for women. 

The operation of scale 3, ‘‘Hysteria’’ (Hy), 
with college students appeared to be different 
than with the patients upon whom it was derived. 
For normal college people, scale 3 coded high 
appears to be indicative of a lack of social prob- 
lems. Scale 3 coded high along with certain other 
scales seems to indicate a variety of tendencies, 
but in most of them, a good general adjustment 
seems prevalent. This should contribute to a 
high degree of teacher effectiveness. The find- 
ings of the present study were that such a rela- 
tionship exists. 

The ‘‘Psychopathic Deviate’’ scale, number 4 
(Pd), seemed to have little to do with college ed- 
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ucated people. Probably persons who are psycho- 
pathic deviates get intotrouble andare eliminated. 
Elevation of this scale is associated with delin- 
quency. There is some evidence that scale 4, in 
combination withother scales, often is associated 
with antagonism to authority, aggressive behav- 
ior, and confiict sttuations when it is elevated in 
a man’s profile. Withwomen this aggressiveness 
seems to be expressed in home conflict or in so- 
cially outgoing behavior depending upon the rest 
of the profile. 

Scale 5 (Mf) was the least well validated of the 
basic scales on the MMPI. It bears the title 
‘*Masculinity- Femininity’? and was designed to 
assist inthe identification of homosexuals. How- 
ever, the scale failed to distinguish between the 
homosexual groupand normals. A high coding of 
this scale among men is particularly frequent in 
an educational setting. It is a complicated scale 
to interpret, but it is one of the most valuable 
scales in counseling students. An elevation of 
scale 5 means different things, depending upon 
what other scales are elevated with it. A low 
coding of scale 5 for women was very common. 
This corresponds to a high coding for men. In 
many cases a low coding of 5 acted as a suppres- 
sor variable for behavior which is suggested by 
the rest of the profile. In some patterns it ap- 
pears to intensify or support the rest of the pro- 
file. Ahighcoding of scale 5 with women appears 
to be associated with socially outgoing behavior. 
This should contribute to teacher effectiveness. 

A high coding of scale 6, ‘‘Paranoid’’, seems 
to occur infrequently with college men except when 
paired with scale 4, ‘‘Psychopathic Deviate’’. In 
this case, it differentiated the anxiety sub-group. 
High coding of scale 6 (Pa) may be an indicator of 
personal sensitivity and perhaps extreme concern 
about the reactions of others to something per- 
ceived by the counselee as a deficiency. With 
teachers a high coding of scale 6 may indicate a 
person who is overly sensitive to the reactions 
of fellow teachers or even to students. 

Scale 7 (Pt) bears the name ‘‘Psychasthenia’’. 
A high coding of scale 7 appears to be related to 
general anxiety states. A low coding with men 
probably indicates good adjustment. With women 
a high coding of scale 7also suggests a feeling of 
insecurity. In general, high codings of this scale 
suggest personal problems, insecurity, state of 
anxiety, physical com plaints—none of which are 
conducive to good teaching and personal relation- 
ships. The present study found an absence of 
scale 7 coded high was somewhat related to high 
supervisory ratings. 

Scale 8, ‘‘Schizophrenia’’, when coded high, 
frequently suggests mental disorganization, vague 
goals, lacking motivation, general confused state. 
This appeared to be more serious with women 
than with men. It would seem that conditions as- 
sociated with scale 8 (Sc) are a hindrance to ef- 


JOURNAL OF EXPERIMENTAL EDUCATION 


fective teaching. 

The ‘‘Hypomania’’ scale, number 9 (Ma), when 
coded high, appeared to indicate aggressiveness 
or belligerence in men and energetic action of a 
more socially approved nature in women. The 
high coding seemed to be modified considerably 
depending upon which scales were coded with it. 
For example, a high coding of scale 0 (Si) witha 
high coding of 9 was associated with social shy- 
ness, but when 0(Si) was low with 9 high, social- 
ly outgoing and verbal behavior was suggested. 
Low codings of scale 9 (Ma) for women were us- 
ually indicative of social shyness when either scale 
0 (Si) or scale 2 (D) was coded low. In general, 
the type of personality to be expected in a teach- 
er with scale 9 coded either high or low seems to 
depend upon what scales are associated with it 
and in what manner they are related. 

It should be emphasized that it is dangerous to 
associate the clinical names of most of these 
scales with individuals who may possess a high 
or low score on them. Perhaps new scales with 
new names should be developed for use when nor- 
mal persons are being studied 


SECTION IV 


Summary and Conclusions 


Statement of the Problem 


The purpose of this study was to investigate 
the relationship, if any, between scores and pro- 
file patterns on the MMPI and success in teaching 
as indicated by supervisory ratings. Personality 
has been considered by many to be an important 
factor in a teacher’s success. The many aspects 
of personality are combined ina multitude of ways 
to make people react differently to various situa- 
tions. It is thought that some assessment of the 
different aspects of a teacher’s personality may 
be helpful in predicting that person’s success or 
failure as ateacher. This study was an attempt 
to discover whether or not there were relation- 
ships between aspects of a teacher’s personality 
and his professional success. 


Subjects and Instruments 


This study was concerned with students who 
were enrolled as freshmen at the Univer sity of 
Wisconsin during the fall semesters of 1949, 1950, 
and 1951, who received the University Teacher’s 
Certificate in 1953, 1954, 1955, or 1956, and who 
subsequently taught in the public schools of Wis- 
consin. One hundred sixty-seven subjects con- 
stituted this population. Onlytwenty of these per- 
sons were males. 

Supervisory ratings were obtained for these 
individuals by submitting a letter and a rating 
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blank to the superintendents, principals, and su- 
pervisors of the schools in which they taught. 

Measures of the various phases of tne teacher’s 
personality were obtained from the results of the 
group form of the MMPI which had been given to 
the subjects when they were freshmen. The 
scores had been coded according to a plan recom- 
mended by one of the authors of the Inventory. 
The MMPI is a widely used instrument that has 
been found valuable in clinical studies. It is im- 
portant that its value for this particular purpose 
should be ascertained. 


Method Employed 


Although several different statistical tech- 
niques were tried with the data of this study, the 
chi-square test seemed the most appropriate and 
provided the best analysis. For purposes of in- 
vestigation the null hypothesis that teachers with 
different personality profiles would not differ in 
their supervisory ratings was established. The 
chi-square technique was used to determine if any 
particular sub-group differed from the whole pop- 
ulation or from certain other sub-groups in re- 
spect to supervisory ratings. Since this was not 
a sampling study, no generalizations to a larger 
group could be made, but the findings could be 
useful in predicting the success of future classes 
of teachers if one were willing to consider the 
population of this study as a sample of the popula- 
tion of future teachers, or that conditions will re- 
main basically constant. 

Comparisons of frequencies, percentages and 
other aspects of the data which seemed pertinent 
were also made. Since the number of males in 
the study was small and it is generally conceded 
that males differ from females in their person- 
ality patterns, the analysis of the data for the 
male teachers was made separately. This was 
limited to the type of descriptive analysis men- 
tioned at the beginning of this paragraph. 


Findings 


The findings of this study briefly summarized 
were: 


1. There were differences in personality pat- 
terns among female teachers withdifferent super- 
visory ratings. A high coding of scale 3 (Hy) for 
women was positively related to a supervisory 
rating of outstanding effectiveness. Scale 3 was 
also coded high very frequently for male teachers, 
but the number of males was too small to make 
any conclusions regarding the relationship. 

2. Scale 5 (Mf) seems to be positively corre- 
lated to supervisory ratings for women teachers. 
The findings in this respect were not very signif- 
icant statistically. Scale 5 coded high was the 
most frequently noted aspect of the male person- 


ality profiles. It was coded among the highest 
three scales 65 percent of the time. 

3. There appears tobe an inverse relationship 
between scale 2 (D) and supervisory ratings for 
women teachers. 

4. Scales 0 (Si), 2 (D), and 5 (Mf) were coded 
lowest more frequently than they were coded 
highest for the women teachers. 

5. Women teachers tended to have scales 
coded low more frequently than men teachers. 


Conclusions 


If one wishes to consider the group here studied 
as representative of future groups of prospective 
teachers, one might conclude that the MMPI has 
good possibilities for helping in the prediction of 
teacher success. While the study has been lim- 
ited by small numbersin many of the sub-groups, 
nevertheless, differences in personality profiles 
did occur for the different supervisory categories. 

Although relatively small samples are fre- 
quently adequate in statistical studies, in inves- 
tigations of this nature, because of the large 
number of sub-groups into which the total group 
is broken down, the sub- groups are frequently 
too small to permit of statisticaltreatment. Such 
an investigation demands ext remely large num- 
bers if a statistical study is to be made. Such 
studies might be carried onover a period of years 
and withthe cooperation of several large teacher- 
training institutions. 

The natural processes of college life and the 
efforts of testing, counseling, and guidance per- 
sonnel tend to eliminate many of the persons with 
extreme personality deviations from the rolls of 
candidates for teaching positions. The MMPI 
can be of help in identifying these individuals. It 
has potential usefulness in aiding in the predic- 
tion of the success of those who do accept teach- 
ing positions. 
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SECTION I 


The Problem and Its Importance 


Statement of the Problem 


THE PURPOSE of this study was to identify and 
then compare profile patterns of teachers on the 
group form ofthe Minnesota Multiphasic Person- 
ality Inventory, hereafter referredto as the 
MMPI, with the profile patterns of selected non- 
teacher groups of students at the University of 
Wisconsin. The three main groups studied, di- 
vided according to sex, were students who were 
graduated from the University of Wisconsin with 
teaching certificates, students with majors in 
Letters and Science who did not prepare for teach- 
ing, and freshmen and sophomores who dropped 
out prior to starting the junior year. Those who 
prepared for teaching were further subdivided in- 
to academic and special field majors. 

Specifically, the researcher will deal with 
the following four questions: 


1. What, if any, MMPI profile patterns are found 
for students who were graduated from the Un- 
iversity of Wisconsin with teaching certifi- 
cates? 

a. Graduates of the School of Education with 
academic majors. 

b. Graduates withteaching certificates in spe- 
cial fields—Home Economics, Music, Agri- 
culture, Art Education, and Physical Edu- 
cation. 


2. What, if any, MMPI profile patterns are found 


for students who were graduated from the Un- 
iversity of Wisconsin from the College of Let- 
ters and Science but did not prepare for teach- 
ing? 


. What, if any, MMPI profile patterns are found 
for students who dropped out of the University 
prior to starting the junior year? 


. If profile patterns are found, how do they com- 
pare among these groups? 


It is hoped that the results of the study may 
prove useful in counseling students indeciding 
between teaching and other non-teaching careers. 

The writer became interested in the MMPI 
when in student personnel work during the period 
of 1948-58. Duringthese years he was privileged 
to see and counsel many students who sought guid- 
ance and who requested assistance in personnel, 
academic, social, and vocational problems. It 
was his primary function to help facilitate the 
growth anddevelopment ofthe student of a realis- 
tic understanding of himself and his relationship 
with society. 

In the disc harge of such functions the use of 
psychometric data may be very helpful. On the 
other hand, they may lead, at times, to erroneous 
conclusions, The fact that psychometric data are 
often useful in many situations must grow out of 
their basic validity for the purpose used. 

While most of the earlier researches on the 
MMPI were done in a hospital setting, research 
has been conducted in a variety of situations with 
more normal persons. Drake and his associates 
(10) have made a number of studies with university 
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They have been extremely generous in giving their time and effort to this investigation. Their continu- 
ous guidance, constructive criticism and encouragement is deeply appreciated. My sincere gratitude is 
also extended to my friends and associates who have encouraged and aided in this study. 
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students. 


Importance of the Problem 


At the present time nearly every large univer- 
sity and most of the smaller institutions offer 
their students some type of guidance service. At 
the University of Wisconsin, for example, the 
Student Counseling Center has offered this ser- 
vice to the students since the Center opened in 
1944. 

One of the important functions of these coun- 
seling centers is that of academic and vocational 
guidance. The work of assisting students in se- 
lecting their academic and vocational goals is dif- 
ficult. Because of thedemands on the part of the 
students for this type of help and the desire on 
the part of the counselors to be effective, it was 
necessary that the MMPI be carefully studied so 
that it may be used as effectively as possible. 

The present study was designed to obtain more 
information about the suitability of using the MMPI 
with University of Wisconsin students in academ- 
ic and vocational guidance, especially in the se- 
lection of future teachers. The MMPI is a wide- 
ly used instrument and has been found useful in 
clinical studies. It is important that its value for 
this particular purpose should be ascertained. 


SECTION Il 


The Procedures Used in the Investigation 


The Design of the Study 


The study here reported was of the compara- 
tive-descriptive type inwhich groups of prospec- 
tive teachers and non-teaching groups were com- 
pared upon scales and profile patterns of the 
MMPI. In an exploratory study such as this, it 
seemed best to work with a well-defined popula- 
tion about whom precise and complete information 
could be had. The study concerned students en- 
rolled at the University of Wisconsin during the 
fall semesters of 1949, 1950, and 1951. 


The Minnesota Multiphasic 
Personality Inventory 


The MMPI was chosen as the measuring instru- 
ment to be used in this study. It is normally ad- 
ministered to students entering as freshmen dur- 
ing freshmen orientation week at the University 
of Wisconsin and the profile codes are entered on 
the cards by the staff of the Student Counseling 
Center. Profiles and other data were thus ob- 
tained for the subjects upon the basis of which 
comparisons were made of the several profile 
patterns. 

The MMPI is a psychometric instrument de- 


veloped at the University of Minnesota. It isa 
product of S. R. Hathaway, Professor and Direc- 
tor of the Division of Clinical Psychology, Uni- 
versity of Minnesota, and J. C. McKinley (de - 
ceased) formerly Head of the Department of Neu- 
ropsychiatry, University of Minnesota. The In- 
ventory was designedto provide, in a single test, 
scores on all the more important clinical phases 
of personality. It seemed that a multiphasic per- 
sonality inventory would be best suited for our 
purposes. 

The instrument consists of 550 different state- 
ments covering a wide range of subject matter, 
from the physical condition of the individual being 
tested to his morale and attitude (15). In admin- 
istering the test, the subject is asked to respond 
to all statements, which are in the first person, 
as True, False, or Cannot Say. After he has re- 
sponded toallitems inthis manner, the responses 
are scored and tabulated to faciliate this part of 
the operation. Drake, at the University of Wis- 
consin Counseling Center, has recorded the sig- 
nificant responses on anIBM machine score sheet. 
This device saves considerable time and labor in 
scoring. Experimentation has shown that it is 
adapted to useful classification and understanding 
of college students. 


Subjects and Data-Gathering Procedures 


The students for this study were students at 
the University of Wisconsin who entered as fresh- 
men in the fallsemesters of 1949, 1950, and 
1951. 

A list of the students who were graduated in 
1953, 1954, and 1955 with teaching certificates 
was obtained ‘from the Office of the Dean of the 
School of Education. The profiles of all these stu- 
dents who had taken the MMPI in 1949, 1950, and 
1951 were used in this study. Of the total of 376 
subjects, 99 were males and 277 females. The 
Korean situation and the fact that a larger per- 
centage of females than males go into the teach- 
ing profession accounts for the larger female 
group. 

The total population consisted of 1407 students, 
654 males and 753 females. The profile patterns 
and other data were obtained from the files of the 
Student Counseling Center. 

Graduates from the College of Letters and Sci- 
ence and freshman and sophomore drop-outs were 
secured from the records on file at the Alumni 
Records Office. The profiles of all the Letters 
and Science students who had taken the MMPI in 
1949, 1950, and 1951 that were readily available, 
278 males and 15} females, compromises the 
population of this group of approximately 1750. A 
total of 502 subjects, 277 males and 225 females, 
were used from the freshman and sophomore drop- 
out group. This represented all subjects for whom 
both drop-out records and MMPI’s were available. 
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Inasmuch as this study attempted to identify and 
then compare profile patterns of students who sub- 
sequently become teachers with profile patterns 
of other selected groups of students, the subjects 
were divided into four groups as follows: 


1. University of Wisconsin graduates with teach- 
ing certificates inthe academic subject fields. 


. Graduates with teaching certificates in special 
fields—Home Economics, Music, Agriculture, 
Art Education, and Physical Education. 


3. Students who were graduated from the Univer- 
sity of Wisconsin from the College of Letters 
and Science but did not prepare for teaching. 


. Students who dropped out of the University 
prior to starting the junior year. 


In order to identify common profile patterns 
among individuals within a group and to compare 
possible profile patterns among groups, each 
group must show relatively homogenous behaviors 
onthe MMPI. Therefore, the group must be se- 
lected on the basis of as many common underly- 
ing traits as possible. In this study the groups 
were divided in accordance to sex and education 
and/or vocational goals. 


Coding of the Data 


The coding system of the profile analysis was 
that reported by Hathaway (14). The scales were 
assigned numbers as follows: 


Social Introversion 
Hypochondriasis 
Depression 

Hysteria 

Psychopathic Deviate 
Masculinity- Femininity 
Paranoid 
Psychasthenia 
Schizophrenia 
Hyponrenia 


None 


All the scales with T scores above 54 were coded 
high and arranged according to magnitude. Only 
the three highest scales were used in this study. 
The scales with T scores of 45 or less were coded 
low with a maximum, in this study, of two being 
coded low except in cases where there were ties 
in which case the first three low scales were in- 
cluded. 


Tabulating the Data 


The frequency of occurrence of each of the fol- 
lowing patterns of scales were tabulated (8): 
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The frequency ofeach scale coded high among 
the three highest scales. 

The frequency of each scale coded low among 
the two lowest scales. (In case of a tie, the 
first three low scales were included. ) 

The frequency of each pair of scales coded 
among the three highest scales. 

The frequency of each scale coded high of the 
three highest with each scale coded low of the 
two lowest. 

The frequency of each pair of high scales coded 
among the three highest with each scale coded 
low of the two lowest. 


Comparisons of the profile patterns among tne 
main groups of students were made by Yule’s 
formula for differentiation of groups (25). This 
formula assumes randomly drawn groups. Strict- 
ly speaking, these groups were not randomly 
drawn. However, for some larger group of Wis- 
consin graduates, the groups might be regarded 
as random groups. To make such a statement it 
must be assumed that conditions remain unchanged 
in all essential conditions and that these condi- 
tions persist for some period of time; also that 
the types of individuals appearing in the data have 
an equal opportunity to appear at each successive 
drawing. The data here are for graduates who 
entered as freshmen in three separate years, 
namely, 1949, 1950, and 1951. The statistical 
test employed in the study answers the question: 
What are the probabilities that differences as 
great or greater than those found might have 
arisen by chance? 


SECTION III 


Statistical Analysis and Findings 


Introduct ion 


The purpose ofthis study, as stated in Section 
I, was to identify and compare profile scales and 
patterns of teachers on the group form of the 
MMPI withthe profile patterns of selected non- 
teacher groups of students at the University of 
Wisconsin. The following four questions were 
asked: 


1. What, if any, MMPI profile patterns are found 
for students who graduated from the University 
of Wisconsin with teaching certificates? 

a. Graduates of the School of Education with 
academic majors. 

b. Graduates withteaching certificates in spe- 
cial fields—Economics, Music, Agriculture 
Art Education, and Physical Education. 


2. What, if any, MMPI profile patterns are found 
for students who were graduated from the col- 
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lege of Letters andScience but did not prepare 
for teaching? 

. What, if any, profile patterns are found for 
students who dropped out of the University prior 
to starting the junior year? 

. If profile patterns are found, how do they com- 
pare among these groups? 


In order to answer these questions it is neces- 
sary to explain how the data were analyzed and 
what the statistical findings were. 


Yule’s Formula for Differentiations of Groups 


In Section I, The Design of the Study, the 
MMPI, the coding of the data, the procedure for 
tabulating the data, were explained. These data 
were analyzed through the use of Yule’s (25) form- 
ula for differentiation of groups. The significant 
difference between the groups was determined by 
the use of the formula for the standard error of 
differences. 


Pi Qi P2 G2 


C122 = n2 


where 
€,> is the standard error of-difference 


p, =the percent of our group having the given 
code type 

= the percent of the group not having the given 
code type 

= the percent of the other group having the given 
code type 

= the percent ofthat group not having the given 
code type 

n, and nz = the number of individuals in each 
group (25) 


The size of e,.2 is an index of the probability 
of the difference in proportions arising through 
chance due tothe fact that the researcher sampled 
the total number of persons engaged as explained 
in Section II. Accordingto Yule, if the difference 
in proportion does not exceed three times the er- 
ror of the difference, it may be obliterated by an 
error of simple sampling on taking fresh samples 
in the same way from thesame material. But for 
practical purposes the probability of the differ- 
ence being obliterated inthis manner is very little 
less if the error is twice the difference in pro- 
portion. 

Six group comparisons were made for each sex, 
male and female, as follows: 


1. Graduates with teaching certificates in the ac- 
ademic subject fields were compared with the 
graduates with teaching certificates in special 
fields. 


. Graduates withteaching certificates in the ac- 
ademic subject fields were compared with stu- 
dents who were graduated from the College of 
Letters and Science but did not prepare for 
teaching. 


. Graduates withteaching certificates in the ac- 
ademic subject fields were compared with stu- 
dents who dropped out of the University prior 
to starting the junior year. 


. Graduates with teaching certificates in special 
fields were compared with students who were 
graduated from the College of Letters and Sci- 
ence but did not prepare for teaching. 


. Graduates withteaching certificates in special 
fields were compared with the students who 
dropped out of the University prior to starting 
the junior year. 


. Students who were graduated from the College 
of Letters and Science but did not prepare for 
teaching were compared with the students who 
dropped out of the University prior to starting 
the junior year. 


In this study a difference in percent was con- 
sidered significant by the researcher if it was two 
or more times as great as its standarderror, i.e., 
it is significant beyond the 5 percent level. 


Statistical Findings 


The statistical findings are summarized in the 
tables that follow. They include results for those 
scales and patterns for which the difference be- 
tween the groups compared is two or more times 
as great as the standard error (9). Code types 
refer to the coding of the scales, either high or 
low, and combinations of scales, paired high and 
high with low. 

In this investigation, combination of scales 
paired high with low scales were not tested for 
significance. The frequencies of occurrence for 
this code type appear in the Appendix (which will 
be found in original thesis on file in Library of 
University of Wisconsin). It was felt that there 
was an insufficient number of subjects to allow 
tests for significant differences between these 
very low frequencies. For the interested re- 
searcher some statistical comparisons could be 
made and other information gained from inspec- 
tion, if sodesired. Drake (9) has reported the 
frequency of occurrence of a number of patterns 
found in male clients. 

In reporting the findings, the tables show the 
percentage of the frequency of occurrence of the 
various code types for all sub-groups compared 
with the corresponding percentage of the frequen- 
cy of other sub~groups along with the critical 
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TABLE I 


COMPARISON OF GRADUATES WITH TEACHING CERTIFICALES IN THE ACADEMIC 
SUBJECT FIELDS WITH THE GRADUATES WITH TEACHING CERTIFICATES 
IN SPECIAL FIELDS— MALES 


Percent of 


Percent of Special Critical 

Code Types Academic Group Fields Group Ratio 
X High 14. 3* 00.0 2. 42 
7 Low 08. 6* 26. 6* 2.47 
13. Paired High 00. 0 07.8 2. 33 
46 Paired High 00.0 09. 4* 2.58 
2-9 High with Low 00. 0 06. 3 2.07 
3-2 High with Low 00. 0 07. 8* 2. 33 
4-8 High with Low 00. 0 10. 9* 2. 79 
6-7 High with Low 00.0 06. 3 2.07 
Number in each group 35 64 


*These items represent samples of 5 cr more cases in one or the other of the com- 
pared group N.B. after the number in each case. 


TABLE II 


COMPARISON OF GRADUATES WITH TEACHING CERTIFICATES IN THE ACADEMIC 
SUBJECT FIELDS WITH THE GRADUATES WITH TEACHING CERTIFICATES 
IN SPECIAL FIELDS— FEMALES 


Percent of 
Percent of Special Critical 

Code Types Academic Group Fields Group Ratio 
0 Low 8m 4s 16. 8* 2.14 
5 Low 42. 1* 30. 1* 2.07 
12 Paired High 03. 0* 00.0 2.26 
0-3 High with Low 03. 0* 10. 6* 2. 38 
4-6 High with Low 03. 0* 00.0 2.26 
5-1 High with Low 02.4 09. 7* 2.41 
9-5 High with Low 16. 5* 08. 0* 2.20 
Number in each group 164 113 


*These items represent sampies of 5 or more cases in one or the other of the com- 
pared group N. B. after the number in each case. 


+ 
4 
lg 
4 
i 
| 
=, 
7 
| 
a 


JOURNAL OF EXPERIMENTAL EDUCATION 


TABLE II 


COMPARISON OF GRADUATES WITH TEACHING CERTIFICATES IN THE ACADEMIC 
SUBJECT FIELDS WITH STUDENTS WHO WERE GRADUATED FROM THE COLLEGE 
OF LETTERS AND SCIENCE BUT DID NOT PREPARE FOR TEACHING—MALES 


Percent of 
Percent of Letters and Critical 
Code Types Academic Group Science Group 


Paired High 

Paired High 

Paired High 

Paired High 

Paired High 

Paired High 

Paired High 

High with Low 
High with Low 
High with Low 
High with Low 
High with Low 
High with Low 
High with Low 
High with Low 
High with Low 
High with Low 
High with Low 
High with Low 
High with Low 
High with Low 
High with Low 
High with Low 
High with Low 
High with Low 
High with Low 
High with Low 


DN ENN NS WNW 


0 
1 
1 
1 
2 
3 
3 
3 
4 
4 
4- 
6 
6 
7 
7 
7 
8 
8 
9 
9 


Number in each group 
*These items represent samples of 5 or more cases in one or the other of the com- 
pared group N. B. after the number in each case. 
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X High 14. 28 
8 High 42. 02 
0 Low 28 
05 00 21 
13 00. 65 
14 00. 21 
36 02. 43 et 
46 00. 21 
56 02. 51 
00 25 
00. 39 
00 66 
00. 66 
00 21 | 
00 14 
00. 82 
t 
00. 66 
05. 47 
4 25 
00. 81 
00 39 
00 66 
00 39 
00 25 
00 21 
00 49 
i 00. 2 1 


TABLE IV 


COMPARISON OF GRADUATES WITH TEACHING CERTIFICATES IN THE ACADEMIC 
SUBJECT FIELDS WITH STUDENTS WHO WERE GRADUATED FROM THE COLLEGE 
OF LETTERS AND SCIENCE BUT DID NOT PREPARE FOR TEACHING— FEMALES 


Percent of 
Percent of Letters and Critical 
Code Types Academic Group Science Group Ratio 


3 High 28. 38. 
5 Low 42.1* 26. 5* 
78 Paired High 20. 1* 

1-6 High with Low 02.4 

2-9 High with Low 04. 9* 

3-X High with Low 02.4 

3-1 High with Low 02.4 

4-5 High with Low 13. 4* 

4-9 High with Low 04. 9* 

7-X High with Low 04. 9* 

7-0 High with Low 06. 7* 

7-5 High with Low 22. 0* 

8-5 High with Low 15. 9* 

8-9 High with Low 04. 9* 


Number in each group 164 151 


*These items represent samples of 5 or more cases in one or the other of the com- 
pared group N. B. after the number in each case. 
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TABLE V 


CCMPARISON OF GRADUATES WITH TEACHING CERTIFICATES IN THE ACADEMIC 
}SUBJECT FIELDS WITH STUDENTS WHO DROPPED OUT OF THE UNIVERSITY 
} PRIOR TO STARTING THE JUNIOR YEAR—MALES 


Percent of Percent of Critical 
Code Types Advanced Group Drop-Outs Ratio 


High 
Low 
Paired High 
Paired High 
Paired High 
Paired High 
Paired High 
Paired High 
Paired High 
Paired High 
Paired High 
Paired High 
Paired High 
Paired High 
0-X High with Low 
0-1 High with Low 
0-2 High with Low 
0-5 High with Low 
0-6 High with Low 
1-2 High with Low 
1-9 High with Low 
2-9 High with Low 
3-2 High with Low 
3-5 High with Low 
4-5 High with Low 
4-8 High with Low 
4-9 High with Low 
5-3 High with Low 
6-7 High with Low 
6-9 High with Low 
7-1 High with Low 
7-5 High with Low 
7-9 High with Low 
8-X High with Low 
8-5 High with Low 
8-6 High with Low 
9-3 High with Low 
9-4 High with Low 
9-7 High with Low 


2 
2 
2 
2 
2 
3 
2 
2 
2 
2 
3 
2 
3 
2 
2 
2 
2 
2 
3. 
2. 
2 
3 
3 
3 
2 
3 
2 
3 
3 
3 
2 
2 
3 
2 
2 
3 
3 
2 
2 


Number in each group 


*These items represent samples of 5 or more cases in one or the other of the com- 
pared group N. B. after the number in each case. 
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14. 3* 02. 2* 02 
08. 6 23. 5* 77 
00. 0 02. 9* 87 
00. 0 01. 8* 25 
00. 0 01. 8* 25 
00. 0 04. 7+ 69 
00. 0 01. 8* 25 
02.9 09. 7* 03 
00. 0 02. 2* 49 
00. 0 02. 5* 66 
00. 0 05. 1* 83 
05.7 15. 2* 24 
ae. 00. 0 04. 0* 39 ae 
00. 0 01. 8* 25 
00. 0 01. 8* 25 
00. 0 02. 2* 49 
00. 0 02. 2* 49 
00. 0 02. 2* 49 
IE 00. 0 03. 6* 21 
00. 0 02. 5* 66 
00. 0 02. 2* 49 
00. 0 04. 3* 52 
A 00. 0 04. 3* 52 =e 
or 00. 0 03. 2* 02 gs 
00. 0 02. 2* 49 
00..0 05. 1* 83 
00. 0 02. 9* 87 
teats, 00. 0 03. 2* 02 ae 
00. 0 05. 1* 83 
00. 0 03. 2* 02 
oe 00. 0 02. 9* 87 ay 
00. 0 02. 5* 66 
00. 0 03. 6* 21 
28. 68 12. 3* . 06 

00. 0 02. 2* 49 
00. 0 03. 6* 21 
00. 0 03. 6* 21 
00. 0 01. 8* 25 
02.9 11. 9* 62 


TABLE VI 


COMPARISON OF GRADUATES WITH TEACHING CERTIFICATES IN THE ACADEMIC 
SUBJECT FIELDS WITH STUDENTS WHO DROPPED OUT OF THE UNIVERSITY 
PRIOR TO STARTING THE JUNIOR YEAR— FEMALES 


Percent of Percent of 

Code Types Academic Group Drop-Outs 

Low 

High 

High 

Paired High 

Paired High 

Paired High 

Paired High 

High with Low 

High with Low 

High with Low 

High with Low 

High with Low 

High with Low 

High with Low 

High with Low 00. 


Number in each group 164 225 


*These items represent samples of 5 or more cases in one or the other of the com-— 
pared group N. B. after the number in each case. 
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TABLE VII 


COMPARISON OF GRADUATES WITH TEACHING CERTIFICATES IN SPECIAL FIELDS 
WITH STUDENTS WHO WERE GRADUATED FROM THE COLLEGE OF LETTERS 
AND SCIENCE BUT DID NOT PREPARE FOR TEACHING— MALES 


Percent of Percent of 
Special Letters and Critical 
Code Types Fields Group Science Group Ratio 


Low 29. 7* 58. 9* 
Low 26. 6* 12. 6* 
Paired High 00. 03. 2* 
Paired High 00. 03. 6* 
Paired High 01. 07. 2* 


Paired High 00. 01. 8* 


Paired High 04. 13. T* 


Paired High 04. 12. 9* 
0-X High with Low 00. 01. 8* 
1-0 High with Low 01. 06. 5* 
3-X High with Low 01. 05. 8* 
3-4 High with Low 00. 02. 5* 
3-6 High with Low 00. 02. 2* 
4-0 High with Low 03. 16. 9* 
4-6 High with Low 00. 03. 6* 
4-8 High with Low 10. 01. 8* 
7-1 High with Low 00. 02. 5* 
8-3 High with Low 00. 02. 5* 
8-2 High with Low 00. 02. 5* 
9-X High with Low 04. 11. 2* 
9-0 High with Low 09. 22. 7* 
9-3 High with Low 00. 02. 2* 


Number in each group 64 278 


*These items represent samples of 5 or more cases in one or the other of the com- 
pared group N. B. after the number in each case. 
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TABLE VIII 


COMPARISON OF GRADUATES WITH TEACHING CERTIFICATES IN SPECIAL FIELDS 
WITH STUDENTS WHO WERE GRADUATED FROM THE COLLEGE OF LETTERS 
AND SCIENCE BUT DID NOT PREPARE FOR TEACHING— FEMALES 


Percent of Percent of 
Special Letters and Critical 
Code Types Fields Group Science Group Ratio 


3. High 26. 5* 39.1* 2.19 
9 High 32. 7* 49. 7* 2. 83 
3. Low 13. 3* 04. 6* 2. 40 
04 Paired High 03.5 .0 . 02 
39 Paired High 05. 3* . 44 
5X Paired High 07. 1* .3 . 24 
67 Paired High 11.5° . 6* . 00 
79 Paired High 10. 2* .20 
89 Paired High 00. . 6* . 50 
4-6 High with Low 00. .6 . 00 
5-1 High with Low 09. . 3* . 06 
5-3 High with Low 04. .0 .28 
6-0 High with Low 03. we .o2 
7-3 High with Low 08. 
7-5 High with Low 23. . 6* . 33 
9-0 High with Low 08. . 6* 2.25 
9-7 High with Low 03. . 6* ey | 


Number in group 113 


*These items represent samples of 5 or more cases in one or the other of the com- _ 
pared group N.B. after the number in each case. 
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TABLE Ix 


COMPARISON OF GRADUATES WITH TEACHING CERTIFICATES IN SPECIAL FIELDS 
WITH THE STUDENTS WHO DROPPED OUT OF THE UNIVERSITY PRIOR 
TO STARTING THE JUNIOR YEAR— MALES 


Percent of 
Special Percent of 
Code Types Fields Group Drop-Outs 


High 

Low 

Low 

Paired High 
Paired High 
Paired High 
Paired High 
Paired High 
Paired High 
Paired High 
Paired High 
High with Low 
High with Low 
High with Low 
High with Low 
High with Low 
High with Low 
High with Low 
High with Low 
High with Low 
High with Low 
High with Low 
High with Low 
High with Low 
High with Low 


* 


' 


Number in group 


pared group N.B. after the number in each case. 


366 
Critical fost 
Ratio 
x 00. 02. 2* 2.49 
3 01 08. 7* 3.07 
26.0" 13. 7* 2.19 Ge 
02 00. 02. 9* 2.87 
met 08 00. 03. 6* 3.21 oe 
14 00. 01. 8* 2. 25 
29 00. 03. 0* 3. 36 
oe 38 00. 02. 5* 2. 66 on 
39 04. 11. 9* 2.19 
5X 00 01. 8* 2.25 
58 15. 04. 3* 2. 40 
x 00. 01. 8* 2.25 
00. 02. 2* 2.49 
00 02. 2* 2.49 
00. 01. 8* 2.25 
a 00. 03. 6* 3.21 Gee 
03. 11. 6* 2.93 
00 02. 9* 2. 87 
00. 03. 2* 3. 02 
00. 02. 9* 2.87 
00. 04. 0* 3. 36 
00.8 02. 2* 2.49 
x 04. 11. 6* 2.11 
00. 03. 6* 3.21 
6 04. 11. 6* 
of . *These items represent samples of 5 or more cases in one or the other of the com- a 


TABLE X 


COMPARISON OF GRADUATES WITH TEACHING CERTIFICATES IN SPECIAL FIELDS 
WITH THE STUDENTS WHO DROPPED OUT OF THE UNIVERSITY PRIOR 
TO STARTING THE JUNIOR YEAR— FEMALES 


Percent of 
Special Percent of Critical 
Code Types Field Groups Drop-Outs Ratio 


50. 7* 


09. 
Paired High 01. 
Paired High 02. 
Paired High 02. 
Paired High 04. 
Paired High 3 00. 
Paired High ‘ 11. 
Paired High 02. 
Paired High ; 07. 
Paired High 12. 
High with Low a 03. 
High with Low Ol. 
High with Low : 05. 
High with Low , 03. 
High with Low : 00. 
High with Low 12. 
High with Low : 06. 


High with Low . 13. 


High with Low é 20. 


High with Low i. 


Number in group 225 


*These items represent samples of 5 or more cases in one or the other of the com- 
pared group N.B. after the number in each case. ~ 
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15 2* 2.24 

23 9* 2. 35 

3X 9 2.00 

39 6* 2. 10 
6X 7* 2.03 
64 6* 2. 10 
69 3.98 

0-9 2. 40 

1-7 4 2.02 

aS 4-1 8* 2. 00 
4-6 \* 2.70 
5-9 9 2. 50 

6-0 9* 3. 33 

6-1 7* 2. 36 
2.18 
9-0 © * 2.90 
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TABLE XI 


COMPARISON OF STUDENTS WHO WERE GRADUATED FROM THE COLLEGE OF 
LETTERS AND SCIENCE BUT DID NOT PREPARE FOR TEACHING WITH THE 
STUDENTS WHO DROPPED OUT OF THE UNIVERSITY PRIO TO 
STARTING THE JUNIOR YEAR— MALES 


Percent of 
Letters and Percent of Critical 
Code Types Science Group Drop-Outs Ratio 


Paired High 

Paired High 

Paired High 

Paired High 

High with Low 
High with Low 
High with Low 
High with Low 
High with Low 
High with Low 
High with Low 
High with Low 
High with Low 
High with Low 
High with Low 
High with Low 
High with Low 
High with Low 
High with Low 


PN 


Number in group 


*These items represent samples of 5 or more cases in one or the other of the com- 
pared group N. B. after the number in each case. 


, 
1 High 18. 9* 11. 6* 13 
5 High 54. 7* 35. 7* 57 
0 Low 58. 9* 25. 8* 97 
Low 03. 6* 08. 7* 51 
5 Low 02. 2* 07. 2* 80 
15 05. 8* 01. 8* 50 
19 07. 2* 03. 2* 13 
57 14. 0* 05. 4* 47 
58 09. 4* 04. 3* 39 A\ 
0-5 00. 0 02. 2* 49 
1-0 06. 5* 01.4 12 
1-5 00. 0 01. 8* 25 ony 
3-1 05. 8* 01.4 80 
3-4 02. 5* 00. 4 03 
Fe 3-5 00. 4 03. 2* 39 ae 
4-8 01. 8* 05.1* 13 
4-9 07. 7* 02. 9* 54 
5-3 00. 4 03. 2* 50 
5-4 04. O* 01.1 18 
7-0 04. 0* 00.7 58 
1-2 00. 4 02. 9* 31 
7-5 00. 0 02. 5* 66 
Fale 8-2 02. 2* 06. 1* 31 an 
9-0 22. 7* 15. 5* 11 


TABLE XI 


COMPARIOSN OF STUDENTS WHO WERE GRADUATED FROM THE COLLEGE OF 
LETTERS AND SCIENCE BUT DID NOT PREPARE FOR TEACHING WITH THE 
STUDENTS WHO DROPPED OUT OF THE UNIVERSITY PRIOR TO 
STARTING THE JUNIOR YEAR— FEMALES 


Percent of 
Letters and Percent of Critical 
Science Group Drop-Outs Ratio 


39.1* 27.1% 


04. 6* | 10. 7* 


Paired High 00. 0 02. 7* 
Paired High 00.0 02. 2* 
Paired High 00. 7 03. 6* 
High with Low 00. 03. 1* 
High with Low 10. 03. 6* 
High with Low 00. 02. 2* 
High with Low 04. 00.9 
6-3 High with Low 00. 04. 0* 
7-X High with Low 12. 05. 8* 
7-3 High with Low 01. 06. 2* 
7-5 High with Low 02. 13. 8* 


Number in group 151 225 


*These items represent samples of 5 or more cases in one or the other of the com- 
pared group N. B. after the number in each case. 
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Code Types 
3 High 2. 42 
3 Low 2. 28 
2.50 
2.24 
4 
2.67 
2.50 
2.24 
2.03 
2.24 
4, 
= 2.18 
2. 63 
a 
3.15 
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ratio of the differences. 

The data relative to male graduates withteach- 
ing certificates in the academic subject fields as 
compared withthe graduates with teaching certif- 
icates inspecificfieldsare given in Table I. Ta- 
ble II makes the same comparisons for females. 
Tables III and IV show the graduates with teaching 
certificates in the academic subjects as compared 
with the students who were graduated from the 
College of Letters and Science but did not prepare 
for teaching. Tables V and VI show the data for 
graduates with teaching certificates in the aca- 
demic subject fields as compared withthe students 
who dropped out of the University prior to start- 
ing the junior year. 

Comparisons of graduates with teaching cer- 
tificates in special fields with students who were 
graduated from the College of Letters and Science 
but did not prepare for teaching are shownin Ta- 
bles VII and VIII. The same comparisons were 
made of the graduates in_special fields with stu- 
dents who dropped out of the University prior to 
starting the junior year in Tables IX and X. 

Tables XI and XII show the data in the same 
way for the students who were graduated from 
the College of Letters and Science but did not 
prepare for teaching as compared with the stu- 
dents who dropped out of the University prior to 
starting the junior year. 

Perhaps the most important and highly signif- 
icant finding is the fact that statistically signifi- 
cant differences did occur, i.e., personality dif- 
ferences as represented by significant differences 
in pattern of scales of the MMPI did occur in all 
groups. 

At this stage of the research it is not possible 
to actually identify the meanings of these person- 
ality differences. Further research may identify 
the meaning of these code types in personality 
terms. This may point to a better idea of person- 
ality variables in the future. 

It appears from the data that there were fewer 
differences among the graduates with teaching 
certificates in the academic fields as com pared 
with the graduates with teaching certificates in 
the special fields than between any other groups. 
The two groups of graduates with teaching certif- 
icates seem to be relatively homogeneous. The 
fact that a grade point average of 2.5 is required 
for admittance tothe School of Education may pos- 
sibly account for this finding together with the 
possibility that the personality characteristics that 
helped lead to selection of teaching as a career. 

The largest number of significant different code 
type frequencies occurredinthe group of students 
who dropped out of the University prior to starting 
the junior year. In considering this finding the 
reader should keep in mind that while a sizeable 
number of academic females (N = 164) was in- 
volved, the number of academic males was only 
35. Scale 9 (Ma) coded high and in combination 


with low coded scales was characteristic of the 
drop-out group. Many of the significant differ- 
ences occur in patterns involving scale7 (Pt), es- 
pecially when scale 7 is coded high with 5 (Mf) 
coded low. The male profiles with no scales (X) 
coded high appears to distinguish the two teach- 
ing certificate groups from the drop-outs. More 
comparisons may be possible through further re- 
search. 

An exam ination of the data also shows that 
more differences in frequencies of code types in 
male groups occurred than in female groups. 
Possibly there are several reasons for this. Many 
counselors have found that college females are 
not as concerned about their academic careers 
as are male students. Also, the number of stu- 
dents inthe female group was larger than the male 
group in the groups of graduates with teaching 
certificates. 


SECTION IV 


Summary and Conclusions 


Statement of the Problem 


The purpose of this study was to identify and 
compare profile patterns of teachers with the pro- 
file patterns of selected non-teacher groups of 
students at the University of Wisconsin on the 
groupformof the MMPI. The three main groups 
studied, divided according to sex, were students 
who were graduated from the University of Wis- 
consin with teaching certificates, students with 
majors in Letters and Science who did not pre- 
pare for teaching, and students who dropped out 
of the University prior to starting the junior year. 
Those who prepared for teaching were further 
subdivided into academic and special field ma- 
jors. 

Conclusions were drawn with reference to four 
questions: 


1. What, if any, MMPI profile patterns are found 
for students who were graduated from the Un- 
iversity of Wisconsin with teaching certif- 
icates? 

a. Graduates of the School of Education with 
academic majors. 

b. Graduates withteaching certificates in spe- 
cial fields—Home Economics, Music, Ag- 
riculture, Art Education, and Physical Ed- 
ucation. 


2. What, if any, profile patterns are found for 
students who were graduated from the College 
of Letters and Science but did not prepare for 
teaching? 


3. What, if any, profile patterns are found for 
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students who dropped out of the University prior 
to starting the junior year? 


4. If profile patterns are found, how do they com- 
pare among the groups? 


While most of the earlier researches on the 
MMPI were done in a hospital setting, research 
has been conducted in a variety of situations with 
normal persons, especially with university stu- 
dents. 


The Design of the Study 


The study here reported was of the compara- 
tive-descriptive type inwhich groups of prospec- 
tive teachers and non-teaching groups were com- 
pared upon scales and profile patterns of the MMPL 
In anexploratory study such as this it seemed 
best to work with a well defined population about 
whom precise and rather complete information 
could be had. The study concerned students en- 
rolled at the University of Wisconsin during the 
fall semesters of 1949, 1950, and 1951. 

The present study was designedto obtain more 
information about the suitability of using the 
MMPI with University of Wisconsin students in 
academic and vocational guidance, especially in 
the selection of future teachers. The MMPI is a 
widely used instrument and has been found useful 
in clinical studies. It is important that its value 
for this particular purpose should be ascertained. 

The data were analyzed through the use of 
Yule’s formula for differentiation of groups. 
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The significance of differences between the groups 
were determined by the use of this formula. 

Difference in profile patterns were found in six 
comparisons made for each sex. 


Findings 
The detailed findings briefly summarized were: 


1. The most important and highly significant find- 
ing is the fact that statistically significant dif- 
ferences did occur among all groups. 


2. It appears from the data that there were few- 
er differences among the graduates with teach- 
ing certificates inthe academic fields as com- 
pared with the graduates with teaching certif- 
icates in the special fields than between any 
other groups. 


3. The largest number of significant code type 
frequencies occurred in the group of students 
who dropped out of the University. 
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4. More differences in frequencies of code types 
in male groups occur than in female groups. 


Conclusions 


This study seems to indicate that significant 
differences in profile patterns on a personality 
test can be found between groups of college stu- 
dents with different academic histories. While 
the study has been limited by the small numbers 
of persons in some sub-groups, nevertheless, per- 
sonality differences as represented by significant 
differences in patterns of scales of the MMPI did 
occur. 

Research is being continued to determine what 
the profile patterns may mean. In this respect, 
counseling experience and further research may 
help. 

There are many interesting and difficult prob- 
lems inresearchdesignfor this area. Group re- 
search techniques may be employed in building a 
usable formulaor to make useful generalizations. 
Our ultimate concern, however, is with indi- 
viduals. 

Further research is needed in this area to de- 
termine what the profile patterns may mean and 
to find a measure that predicts early and ade- 
quately the personality variables involved in later 
success. 
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A COMPARISON 


OF THE READABILITY OF 


VOCATIONAL AGRICULTURE REFERENCE 


BOOKS WITH THE READING ABILITY 
OF THE STUDENTS USING THEM* 


RALPH R. BENTLEY and R. EDWARD GALLOWAY** 
Purdue University 


Introduction 


TEACHERS OF vocational agriculture often 
complain that their students do not understand what 
they read. In vocational agriculture, as in other 
high-school sub;ects, reading is one of the most 
effective and efficient tools of learning. However, 
the usefulness of this tool is lost if the material 
to be read does not reasonably match the capabil- 
ity of the reader. If the material is too difficult, 
the student will not comprehend; if it is too sim- 
ple, the student may be insulted and/or bored. In 
either case, learning suffers. 

Few studies have been reported which attempt- 
ed to match the readability of text or reference 
materials with the reading ability of high-school 
students. Althoughthe readability of a large num- 
ber of agricultural reference materials has been 
reported, no extensive study was found which 
compared their readability with the tested read- 
ing ability of the students actually using them. 


Purpose 


It was the purpose ofthis study to compare the 
readability of widely used agricultvral reference 
books with the reading ability of the vocational 
agriculture students usingthem. In order to make 
' this comparison, it was necessary to measure 
both the readability of vocational agriculture ref- 
erence books and the reading ability of students 
of vocational agriculture who were using them. 


Procedure 


Selection of Cooperating Schools. One rela- 
tively large high school withan enrollment of over 
100 students and one relatively small high school 


with an enrollment of under 100 students were 
chosen in each of the twelve vocational agricul- 
ture districts inIndiana. Large and small schools 
were selected in each district on the basis of 
three criteria: 1) the school had a department of 
vocational agriculture approved by the Indiana 
State Department of Public Instruction, 2) the 
teacher of vocational agriculture had taught at 
least one year inthe school, and 3) both the teach- 
er of vocational agriculture and his administra- 
tor expressed their wil}bingness to cooperate in 
the study. The basic data for this study were ob- 
tained by testing the reading ability of the voca- 
tional agriculture students in these schools, and 
by measuring the readability of the agricultural 
reference books in their libraries. 

Measurement of Readability. Responses ofthe 
cooperating teachers of vocational agriculture to 
a survey indicated that almost 100 reference books 
were available in their libraries in quantities 
large enough for class use. Ten of the books 
found most frequently in the cooperating schools 
were chosenfor readability measurement. These 
books were A) Your Farming Program, B) Shop- 
work on the Farm, C) Profitable Farm Manage- 
ment, D) Beef Production, E) Livestock and Poul- 
try Production, F) Approved Practices in Beef 
Production, G) Veterinary Guide for Farmers, 
H) Crop Production, roductive Soils, 

Feeds and Feeding (abr. ). 

The Dale-Chall Readability Formula was used 
to measure the readability or reading difficulty of 
these ten books. This meaurement yielded a 
raw score for each of twenty or more sample 
portions of reading material from each book. The 
readability of each book was expressed as a mean 
and a standard deviation of the sample scores. 
Analysis of variance was used to test differences 


* Adapted from a Ph. D. dissertation completed at Purdue University. 


**The authors wish to express their gratitude to the Purdue Research Foundation for its support of this 
study. if 
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among the ten books. 

Measurement of Reading Ability. Two tests 
were used to measure the reading ability of voca- 
tional agriculture students. The Cooperative Eng- 
lish Tests, Test Cl, ‘‘Reading Comprehension’’, 
was used to measure general reading ability, and 
the Iowa Tests of Educational Development, Test 
6, ‘‘Ability'to Interpret Reading Materials in the 
Natural Sciences’’, waschosenasthe most appro- 
priate test of ability to read tec hnical materials 
in agriculture. The Verbal Battery and the Non- 
verbal Battery of the Lorge- Thorndike Intelligence 
Tests series were used to determine the mental 
ability of these students. These tests were ad- 
ministered by the teacher of vocational agr icul- 
ture in each high school during his regular voca- 
tional agriculture class periods. After the scores 
for each grade from each of the tests were ana- 
lyzed by analysis of variance, the means and 
standard deviations were calculated for each 
school and/or groups of non-differing schools, de- 
pending upon the results ofthe significance tests. 
These means and standard deviations were con- 
verted to grade level units. 


Results 


The results ofthis study, designed to compare 
the readability of certain agricultural reference 
books with the reading ability of the students us- 
ing them, are presented under three headings: 1) 
readability of agricultural reference books, 
2) reading ability of vocational agriculture stu- 
dents, and 3) comparison of book readability with 
student reading ability. In each of these three 
sections, hy pot heses are stated, an analysis of 
relevant data is presented, and conclusions are 
drawn. The . 05 level of significance was used. 

Readability of Vocational Agriculture Refer- 
ence Books. The raw Dale-Chall scores for sam- 
ple portions of reading material in each of the ten 
selected books furnished the basic readability 
data. Bartlett’s test was used to test the homo- 
geneity of within-book variances and a one-way 
analysis of variance was used to test the signifi- 
cance of differences among the mean Dale-Chall 
readability scores for the ten books. These tests 
indicated that significant differences existed both 
among the variances and the means for the ten 
books. Therefore, each book was treated, indi- 
vidually in the com parison with student reading 
ability. 

Both the meanandthe standard deviation read- 
ability for each book was converted from raw Dale- 
Chall score units to grade-levelunits. This made 
a direct com parison of readability and reading 
ability scores possible. 

Reading Ability of Vocational Agriculture Stu- 
dents. The raw scores for both the Cooperative 
Reading Test and the Iowa Reading Test furnished 
basic reading ability data. The data for each of 


these tests were analyzed by two-way analysis of 
variance and presented separately for each of the 
four high-school grades. 

It was hypothesized that the reading ability of 
ninth-grade students did not differ significantly 
with respect to the size and location of the schools 
attended. The results of the analysis of variance 
for both of the reading tests and the significance 
of the obtained F values are shown in Table I. 

The reading ability of ninth-grade students as 
measured by the Cooperative and Iowa Reading 
Tests (Table I) did not differ significantly among 
the cooperating schools when they were grouped 
by district and size. Thus it was concluded that 
the differences among districts and between sizes 
could have occurred by chance and that these stu- 
dents belong to the same population with respect 
to reading ability as measured by these two tests. 
Population means and standard deviations for the 
Cooperative and the lowa Reading Tests are shown 
in Table II. 

It was hypothesized that the reading ability of 
tenth-grade students did not differ significantly 
with respect to tae size and location of the schools 
attended. The results of the analysis of variance 
for each test and the significance of the obtained 
F values are shown in Table III. 

The reading ability of tenth-grade students as 
measured by the Cooperative Reading Test did not 
differ significantly among the cooperating schools 
when they were grouped by district and size (Ta- 
ble III). Thus it was concluded that the differences 
among districts and between sizes could have 
occurred by chance and that these tenth-grade 
students of vocational agriculture belong to the 
same population with respect to their reading abil- 
ity as measured by the Cooperative test. Table 
III also shows that ninth-grade students are sig- 
nificantly different from district to district on 
reading ability as measured by the Iowa test. 

The significant F values for interaction in Ta- 
ble III indicate that unique effects of school size 
occur in some districts for reading ability as 
measured by the Iowatest. Therefore, it was 
concluded that students in the various districts 
belong to different populations and that students 
in individual sc hools belong to different popula- 
tions with respect to their reading ability as 
measured bythe Iowa test. The population mean 
and the standard deviation for the Cooperative 
Reading Test are shown in Table IV. The means 
and standard deviations forthe lowa Reading Test 
are given in Table V for students in each large 
and small school by districts. 

It was hypothesized that the reading ability of 
eleventh-grade students of vocational agriculture 
did not differ significantly with respect to the size 
and location of the schools they attended. The 
results ofthe analysis of variance for both read- 
ing tests and the significance of the obtained F 
values are shown in Table VI. 
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TABLE I 


TWO-WAY ANALYSIS OF VARIANCE OF READING SCORES MADE BY NINTH-GRADE 
STUDENTS OF VOCATIONAL AGRICULTURE 


Source of Weighted Sums Mean Significance 


Variance of Squares d. f. Square of F Value* 


Cooperative Reading Test 


District 164. 0413 
Size 21. 3928 
Interaction 116. 8760 


Within 107. 1249 
Iowa Reading Test 


District . 4164 10 38. 9416 
Size . 1405 1 58. 1405 
Interaction . 219 10 25. 822 
Within . $75 191 23. 1705 


*N.S. indicates that the observed F was not significant at the . 05 level. 


TABLE I 


MEANS AND STANDARD DEVIATIONS FOR THE COOPERATIVE 
AND IOWA READING TESTS FOR NINTH-GRADE STUDENTS 
IN TWENTY-TWO SCHOOLS 


Mean Grade Level Grade Levels 
Tests of Ability of S. D. 


Cooperative Reading 71.5 2.5 


Iowa Reading 8.7 2.0 
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TABLE It 


TWO-WAY ANALYSIS OF VARIANCE OF READING SCORES MADE BY TENTH-GRADE STU- 
DENTS OF VOCATIONAL AGRIC ULTURE 


Source of Weighted Sums Mean Significance 
Variance of Squares a. f. Square of F Value* 


Cooperative Reading Test 


District . £533 
Size . 1195 
Interaction . 498 

Within : . 0704 


Iowa Reading Test 


District . 5512 48. 
Size . 010043 7 
Interaction 641. 842 64. 
Within 4134. 81 23. 


*N.S. indicates that the observed F was not significant at the . 05 level. 


TABLE IV 


MEAN AND STANDARD DEVIATION FOR THE COOPERATIVE READ- 
ING TEST FOR TENTH-GRADE STUDENTS IN 
TWENTY-TWO SCHOOLS 


Mean Grade Levels of 
Test Grade Level Standard Deviation 


Cooperative Reading 8.3 3.3 
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TABLE V 


MEANS AND STANDARD DEVIATIONS FOR THE IOWA READING TEST FOR 
TENTH-GRADE STUDENTS BY DISTRICT AND SCHOOL SIZE 


Large Small 


Mean Standard Mean Standard 
District Grade Level Deviation Grade Level Deviation 


Iowa Reading 
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I 10. 0 2.8 7.6 

9.4 1.2 11.1 4.2 
9.8 2.3 11.9 4.6 
IV 11.1 4.9 10.4 2.8 
8. 6 1.0 10.8 3.2 

VI 11.1 3. 8 12.4 5.3 

vil 11.1 3.0 8.0 0.3 

vill 9.8 2.3 9.0 2.3 
og Ix 8. 6 1.8 9.7 1.6 
XI 9.3 3.1 12. 2 3.7 

9.6 2.9 8.5 2.7 


The reading ability of eleventh-grade students 
as measured by the Cooperative and Iowa tests 
did not differ significantly among the twenty-two 
cooperating schools when they were grouped by 
district and size. Thus it was concluded that the 
differences observed among districts and between 
sizes could have occurred by chance and that these 
students belong to the same population with re- 
spect to their abilities as measured by these two 
tests. 

Population means and standard deviations for 
the Cooperative and the Iowa Reading Tests are 
shown in Table VII. 

It was hypothesized that the reading ability of 
twelfth-grade students did not differ significantly 
with respect tothe size and location of the schools 
they attended. The results of the analysis of var- 
iance for each of the reading tesis andthe signif- 
icance of the obtained F values are shown in Ta- 
ble VIII. 

The reading ability of twelfth-grade students 
as measured by the Cooperative and the Iowa 
Reading Tests did not differ significantly am ong 
districts but diddiffer significantly between large 
and small schools. Therefore, it was concluded 
that the differences between large and small 
schools probably did not occur by chance and that 
the twelfth-grade students in large schools belong 
to a different population withrespectto the Coop- 
erative and the Iowa Reading Tests. Means and 
standard deviations are shown in Table IX for 
twelfth-grade students on the Cooperative and Iowa 
Reading Tests by large and small schools. 

Comparison of Book Readability with Student 
Reading Ability. In order to determine how ap- 
propriate vocational agriculture reference books 
are for the students who .use them, comparisons 
were made on the basis of the readability grade 
levels of reference books as determined by the 
Dale-Chall formula and the grade levels of read- 
ing ability of students as measured by the Coop- 
erative and Iowa Reading Tests. Both mean and 
standard deviation grade levels were used in these 
comparisons. Figure 1 shows these means and 
standard deviations graphically. 

The upper portionof Figure 1 presents the data 
regarding ten agricultural reference books. Each 
bar in this portion of the figure shows the mean 
and the range, minusoneto plus one standard de- 
viation, in grade levels of book readability. For 
example, the first bar in Figure 1 shows that the 
book, Your Farming Program, has eighth-grade 
mean readability and that two-thirds of the read- 
ing material in this book falls between 6. 4 and 
9. 6 grade levels. 

The lower portion of Figure 1 graphically pre- 
sents information that was shown in Tables II, IV, 
V, VII, and [IX about the reading ability of stu- 
dents. Each bar inthis portion of the figure 
shows the mean and the range in grade levels of 
student reading ability from minus one to plus one 
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standard deviation. Thus, the ninth-grade stu - 
dents of vocational agriculture in the twenty-two 
cooperating schools had mean general reading 
ability of grade 7.5 as measured by the Cooper- 
ative Reading Test and two-thirds of these stu- 
dents had a reading ability range of grade 5. 0 and 
10. 0. 

It will be noted that the mean reading ability 
of students for each grade level was higher when 
measured by the Iowa Reading Test than when 
measured by the Cooperative Reading Test. It 
will also be noted that mean student reading abil- 
ity was higher for each succeeding high-school 
grade except for twelfth-grade students inthe 
large high schools. However, reading ability, as 
measured by these tests, fails to increase a full 
grade level for students in each succeeding high- 
school grade. 

Since there was significant interaction among 
schools with respect to the Iowa Reading Test 
scores for tenth-grade students, it was not per- 
missable to pool these scores for all tenth-grade 
students. To show the extreme range of reading 
ability of tenth-grade students, the highest and 
the lowest means and their respective standard 
deviations are shown in Figure 1. 

In general, Figure 1 shows that the means for 
book readability are higher than the means for 
student reading ability. The grade level means 
for the ten books studied range from grades eight 
to eleven with standard deviations ranging from 
1.6 to 2. 7 grade levels. The student grade level 
means for scores onthe Cooperative Reading Test 
range from 7.5 to 9.9 with standard deviations 
ranging from 2. 5 to 3. 3. 

In the following paragraphs the readability of 
the books as measured by the Dale-Chall formula 
will be compared with the reading ability of voca- 
tional agriculture students as measured by the 
Cooper ative and the Iowa Reading Tests. Both 
readability and reading ability will be expressed 
as grade levels. For example, a pupil with ninth- 
grade reading ability as measured by the Cooper- 
ative Reading Test has a score equal to the me- 
dian score made on this test by students in the 
publisher’s norm groupwho were halfway through 
their ninth yearofschool. Ninth-grade readabil- 
ity implies that the reading material can be read 
by students who are halfway through the ninth 
grade. These comparisons are presented sepa- 
rately for each of the four high-school grades. 

Figure 1 shows that allten of the books studied 
have mean readability scores above the mean 
reading ability for ninth-grade students as meas- 
ured by the Cooperative Reading Test. Although 
these same students scored a grade higher on the 
Iowa Reading Test, nine of the ten books are still, 
on the average, toodifficult for these ninth-grade 
students. 

The overlapping of standard deviation bars in 
in Figure 1 shows that while the most able ninth- 
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TABLE VI 


TWO-WAY ANALYSIS OF VARIANCE OF READING SCORES MADE BY ELEVENTH-GRADE 
STUDENTS OF VOCATIONAL AGRICULTURE 


Source of Weighted Sums Mean Significance 
Variance of Squares d. f. Square of F Value* 


Cooperative Reading Test 


District 1366. 0296 10 136. 6030 
Size 254. 10000 1 254. 10000 
Interaction 1946. 477 10 194. 6477 
Within 16080. 218 156 103. 0783 


Iowa Reading Test 


District 69. 6304 6. 9630 
Size 47. 3594 47. 3594 
Interaction 388. 373 38. 8373 
Within 3777. 077 23. 9056 


*N.S. indicates that the observed F was not significant at the . 05 level. 


TABLE VII 


MEANS AND STANDARD DEVIATIONS FOR THE COOPERATIVE AND 
IOWA READING TESTS FOR ELEVENTH-GRADE STUDENTS 
IN TWENTY-TWO SCHOOLS 


Mean Grade Levels of 
Tesis Grade Level Standard Deviation 


Cooperative Reading 
Iowa Reading 
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TABLE VIII 


TWO-WAY ANALYSIS OF VARIANCE OF READING SCORES MADE BY TWELFTH-GRADE 
~ STUDENTS OF VOCATIONAL AGRIC ULTURE 


Source of Weighted Sums Mean Significance 
Variance of Squares d. f. Square of F Value* 


Cooperative Reading Test 


District ; 10 . 2590 
Size : 1 . 5533 
Interaction 10 $113 
Within ‘ 132 . 9699 


Iowa Reading Test 


District . 3408 10 . 3341 
Size . 4966 1 . 4966 
Interaction . 851 10 . 2851 
Within . 243 132 . 5018 


*N.S. indicates that the observed F was not significant at the . 05 level. 


TABLE IX 


MEANS AND STANDARD DEVIATIONS FOR THE COOPERATIVE AND IOWA READING 
TESTS FOR TWELFTH-GRADE STUDENTS SHOWN BY LARGE 
AND SMALL SCHOOLS 


Large Small 


Mean Grade Level Mean Grade Level 
Tests Grade Level of S. D. Grade Level of S. D. 


Cooperative Reading 9.0 3.3 9.9 2.7 


Iowa Reading 4.2 11.2 3.7 
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FIGURE I 


GRAPHIC ILLUSTRATION OF MEANS AND STANDARD DEVIATIONS FOR DALE- 
CHALL READABILITY OF TEN AGRICULTURAL REFERENCE BOOKS AND 
FOR READING ABILITY OF VOCATIONAL AGRICULTURE STUDENTS AS 
MEASURED BY THE COOPERATIVE AND IOWA READING TESTS 


Readability of Book! 


Reading Ability” of Students in: 


Ninth Grade 


Cooperative 
Iowa 


Tenth Grade 
‘Cooperative 
Iowa— Lowest School 
—Highest School3 
Eleventh Grade 
Cooperative 
Iowa 


Twelfth Grade 
Large Schools- 
Cooperative 
Iowa 


Small Schools- 
Cooperative 


Iowa 


8 9 10 11 12 13 14 15 16 


5 


J 


4 5 6 


7 8 9 10 11 12 13 14 15 16 


I Titles of these ten books are found in the list of books at the end of this study. 
2Reading ability as measured by the Cooperative and the Iowa reading tests previously described. 
3Since no pooling was permissable here, only the extreme schools are shown. 
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grade readers can be expected to read all but the 
most difficult portions of these ten books, the 
least able readers could be expected to read only 
the easiest portions of books A and B. 

It is shown in Figure 1 that nine of the ten 
books have mean readability scores higher than 
the mean reading ability scores for the tenth- 
grade students as measured by the Cooperative 
Reading Test. When compared to mean reading 
ability as measured by the Iowa Reading Test, the 
average reading ability for each of the ten books 
exceeds the lowest tenth-grade class mean and is 
exceeded by the highest tenth-grade class mean. 

The standard deviation bars show that the most 
able tenth-grade students can be expected to read 
a major part of the material in each of these ten 
books and that all but the poorest readers can be 
expected to read selected portions ofthese books. 

Figure 1 shows that the mean readability of 
two of the ten books was below the average read- 
ing ability of eleventh-grade students and of 
twelfth-grade students in large schools as meas- 
ured by the Cooperative Reading Test. 

Eight books were above their reading ability. 
When reading ability was measured by the Iowa 
test, only half of the books were toodifficult, and 
two were somewhat too easy for these students. 

The standard deviation bars indicate that the 
more able readers in the eleventh gradé and in 
the twelfth grade of large schools can be expect- 
ed to read all except the most difficult portions 
of these ten books and that these students will 
possibly find much material in books A through E 
too easy. The poorest ele venth-grade readers 
can be expected to read most of books A and B 
and the easier portions of the other eight books, 
while the least able twelfth-grade readers in large 
schools will probably experience difficulty in 
reading any of these books. 

Figure 1 shows that the twelfth-grade students 
in the small schools de monstrate reading abil- 
ity about one grade level higher than the twelfth- 
grade students inlarge schools. When compared 
on their Cooperative Reading Scores, the ability 
of these students was above the mean readability 
of books A and B; was about equal to the read- 
ability of books C, D, and E; and was one grade 
level below the means for books F through J. On 
the basis of their lowascores, these students had 
average ability slightly above the mean readabil- 
ity for each of the ten books. 

When the standard deviation bars for the books 
were compared with those for the twelfth-grade 
students in small schools, Figure 1 shows that 
the most capable readers inthis group can be ex- 
pected to read practically all of the material in 
the ten books with ease. However, these books 
contain few portions whichthe least able readers 
can read. 


Conclusions and Implications 


The following conclusions were drawn on the 
basis of reading ability data obtained from the vo- 
cational agriculture students in cooperating 
schools and readability datafrom reference books 
selected from the libraries of those schools. Inthe 
interpretation of these conclusions, one should be 
mindful of the limitations imposed by the design 
and measurements used in this study. 

1. Each ofthe vocational agriculture reference 
books had a mean readability appropriate for stu- 
dents of average reading ability inone of the four 
high-school grades. 

2. Twelfth-grade students, especially those in 
large schools, were characterized by their low 
reading ability. 

3. Ingeneral, reading ability did not differ 
with respect to school size and location. 

4. In general, verbal mental ability did not dif- 
fer with respect to school size and location. 

5. Nonverbal mental ability varied widely 
among individual schools. 

6. Reading ability varied widely both among 
vocational agriculture classes and within classes 
at a given grade level. 

7. Students of vocational agriculture scored 
from one to two grade levels higher on the Iowa 
Test of Reading in the Natural Sciences than they 
did on the Cooperative General Reading Test. 

8. Vocational agriculture students had mean 
reading abilities which ranged from zero to three 
grade levels below their peers on the basis of 
publisher’s norm groups. 

9. Although there was wide variation from 
school to school in the mental ability of vocation- 
al agriculture students, in general, their mental 
ability was similar to that of their peers as rep- 
resented by publisher’s norm groups. 

10. In general, the agricultural reference 
books used by the students of vocational agricul- 
ture tended to be too difficult for their reading 
ability. 


The findings and conclusions of this study ap- 
pear to have several implications for workers in 
the field of education. These are listed as fol- 
lows: 

1. It seems apparent that if a single vocational 
agriculture textbook were selected for use by stu- 
dents in a given grade, some students would ex- 
perience difficulty reading any but the most read- 
able portions and some would find all but the 
most difficult portions distressingly easy. There- 
fore, it seems desirable to use a variety of ref- 
erence materials with varied readability in each 
agricultural subject area. 

2. Teachers cannot assume that a student is 
an average reader because he possesses average 
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mental ability. 

3. When authors and publishers prepare 
agricultural reference books, they should give 
special attention to book readability and the 
reading ability »f vocational agriculture stu- 
dents. 

4. The fact that vocational agriculture students 
consistently scored higher onthe test of ability to 
read natural science materials thanon the general 
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reading tests suggests that the abilityto read ag- 
ricultural references may be specific and differ- 
ent from general reading ability. 

5. Teachers of vocational agriculture should 
include readability as a factor in the selection of 
reference books. 

6. Teachers of vocational agriculture should 
give special attentiontothe reading problems en- 
countered by their students. 
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THE RELATIONSHIP OF CERTAIN LETTER 
FORM VARIANTS IN THE HANDWRITING 
OF FEMALE SUBJECTS TO THEIR 
EDUCATION, I.Q. AND AGE 


LAWRENCE EPSTEIN, HUNTINGTON HARTFORD 
IRVING TUMARKIN* 
Columbia University 
College of Physicians and Surgeons 
Handwriting Institute, Inc. ** 


THE MODEL of good penmanship has remained 
the same throughout the United States for many 
years, despite the fact that the methods used to 
teach handwriting have undergone considerable 
change. Asaresult, this basic handwriting model, 
which has been called the ‘‘school-copy’’ model 
by Lewinson and Zubin (6), may be used as a 
yardstick to evaluate the tendency of individuals 
to deviate from what they first learned. 

Everyone who writes has deviated somewhat 
from the ‘‘school-copy’’ form by altering the forms 
and size ratios of his letters in an idiosyncratic 
way. It is for this reason that signatures can be 
accepted as legal identification all over the world. 
Furthermore, it is the fact that each individual 
learns to write in a unique but consistent way 
which underlies the science of graphology. 

Two essential reasons that eachindividual de- 
parts from the ‘‘school-copy’’ formareto achieve 
efficiency and speed. Naturally, the demand for 
legibility remains evenafter the demand for rigid 
reconstruction of the school-copy form is relaxed. 
Typically, handwriting is not taught to students 
over 14 years of age and thus, it is then that the 
tendency to vary accelerates. Many students 
crystallize their own writing styles in high school 
or, perhaps, incollege when they are called upon 
to take lecture notes at high speeds. 

If handwriting typically departs from the 
school-copy model, what thenis reflected in those 
adult handwritings which closely adhereto, rather 
than depart from, the school-copy model? If we 
regard such samples as cases of arrested hand- 
writing development it would seem to follow that 
such handwritings may also reflect an arrested 
intellectual and/or emotional development. 

Ina recent study, Epstein and Hartford (4) 
found that ina group of male medical students the 
retention of the superfluous initial upstrokes on 


*All footnotes will be found at end of article. 


the letters u, v, w, and y! was, infact, relatea 
to emotional immaturity. In another recent un- 
published study, Linton, Epstein and Hartford 
found the use of these initial upstrokes to be as- 
sociated ‘‘ with relative inadequacy and lack of en- 
ergy inintellectual functioning and other forms of 
coping with the environment... 

In our survey of earlier graphological studies, 
we can find but few studies dealing with the rela- 
tionship between handwriting and intelligence in 
adult subjects. 

Thorndike (11) and Omwake (7) have reported 
virtually zero correlations between scales of 
handwriting quality2 and adult intelligence. These 
results, in effect, indicate the lack of relation- 
ship between adult intelligence and conformity to 
such school-copy values as legibility, aesthetic 
appearance, and neatness. In children, however, 
since they learn to write while under strong ex- 
ternal pressure to conform to the school-copy 
model, correlations of about . 30 have been found 
by Gesell (5) and Starch (10) bet ween ratings of 
handwriting quality and general scholarship. 

The Thorndike and Omwake studies, in having 
established that adherence to school-copy values 
in adult handwritings is not positively related to 
intelligence, raised the further question of what 
departures, if any, from the school-copy might 
be associated with intelligence in adult subjects. 
A study perfor med by Castelnuovo- Tedesco (3) 
pointsthe way. Heinstructed six untrained judges 
to rate 100 adult handwritings for intelligence and 
originality, separately, and then correlated these 
ratings with I.Q. scores. As criteria for intel- 
ligence, the judges were told to use aesthetic 
spacing, handwriting speed, and the simplifica- 
tion (and/or) deviations of the letter forms. They 
were told to use as the main criteria for judging 
originality ‘‘the extent to which the writer of a 
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TABLE I 


g, d, AND f VARIANTS AND THE FREQUENCY AT WHICH THEY OCCUR 
AT LEAST ONCE IN A WRITING SAMPLE 
(N = 150) 


8 x. thi 


Variant Variant Variant f 


d 


74 


f 
* 


143 


*School copy 
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given script has followed, in the process of writ- 
ing a specific letter, a different-writing- pattern 
from that which he was probably taught in school.’’ 
These correlations were all at least .50, and 
since 100samples were rated it is extremely un- 
likely that the obtained relationships came about 
as a result of sampling errors. 

The only other study in which judges were suc- 
cessful in predicting handwriting from intelligence 
is that reported by Binet (2). He used profes- 
sional graphologists. Unfortunately, however, 
the handwriting criteria upon which these graph- 
ologists based their predictions have not been in- 
dicated. 

In the present study, our purpose was to ex- 
plore the relationship of particular deviations 
from the school-copy letter forms tothe eduea- 
tional level, the I.Q. and the age of a group of 
female writers. 


Met hod 


Samples of the writing of 150 female clients 
were selected from the files of the NYU Testing 
and Advisement Center. An examination of them 
suggested three letters as worthy objects of in- 
vestigation because they permitted wide grapho- 
logical variations within the three handwriting 
zones—upper, middle and lower, without loss of 
identity. These letters were g, d, andf. The 
more predominant script variations of these let- 
ters within our sample were then noted. 

In addition to the school-copy form, there were 
five form variants of the letter d, six form vari- 
ants of the letter g, and six of the letter f. For 
purposes of analysis, the appearance of at least 
one instance of a particular letter variant ina 
writing sample was considered sufficient to de- 
scribe that variant as present in this sample. For 
each variant of the letter g, d, andf, the number 
of samples in which it was present was deter- 
mined. For instance, the school-copy g appeared 
at least once in 143 of the 150 writing samples. 
Table I presentsthe form variants for each of the 
letters and the number of Ss who used each vari- 
ant at least once. , 

The experimenters also were struck by an ad- 
ditional handwriting phenomenon. Some Ss econ- 
omized in a special way in writing the word ‘‘of’’. 
They would convert the upstroke normally used to 
round off the letter o directly into the initial up- 
stroke of the following f. We selected this phen- 
omenon for separate study and it is shown in Ta- 
ble II, whichalso presents the number of samples 
in which it was present at least once. 

The ages, I.Q.’s and the highest grades at- 
tained by the subjects were recorded. The ages 
ranged from 15 to 55 and the median age was 19 
years. The I.Q. scores, which were either 
scores onthe Wechsler Bellevue Intelligence Scale 
or the Wechsler Adult Intelligence Scale, ranged 


TABLE II 


“*Of’? CONNECTIVE AND THE FREQUENCY AT 
WHICH IT OCCURS AT LEAST ONCE INA 
WRITING SAMPLE 
(N = 150) 


Variant 


744 


from 80 to 145. The median I.Q. score was be- 
tween 124 and 125. It was decided to use-125 as a 
cut-off point for various statistical tests. 

As for educational level, the subjects at the 
lowest level had completed the eleventh grade, and 
the subjects at the highest level had completed 
more than four years of college (Table III). The 
subjects were divided into two groups on the basis 
of grade completed, one group consisted of those 
who had gone no further than the twelfth grade (the 
first two groups on Table III), and the other con- 
sisted of those who had gone to college for at least 
some period. 

In sum, the distributions of scores on three 
variables, age, I.Q. and grade completed, were 
dichotomized for purposes of doing statistical 
tests. The best approximation of the median was 
used as the cut-off point in each case. 


Characteristics of the Sample 


A preliminary analysis of the criterion vari- 
able was made to throw light on the nature of the 
sample. The correlation between age and educa- 
tion was .42. The vast majority of subjects were 
still in school so that this correlation was to be 
expected, since educational level depends upon 
age among subjects who are of school age. 

The correlation between age and I.Q. was .27. 
The older subjects in the sample were predomin- 
antly those who had continued their education be- 
yond the period of compulsory attendance. Un- 
doubtedly such subjects are mainly from the upper 
intelligence range, sothere was a selective factor 
in favor of high I.Q. scores at the upper age 
levels. The correlation bet ween education and 
I.Q. was . 34 for the same reason. 


Results and Discussion 


The relationship ofthed variant to age, educa- 
tion and I.Q. are presentedin Tables IVa and IVb. 
Table IVa, containing the phi coefficients for the 
more frequently appearing d variants, shows only 
one significant negative relationship, a negative 
one between age andthethird d variant. (Signit - 
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TABLE Ill 


DISTRIBUTION OF THE HIGHEST GRADES COMPLETED 
BY THE 150 FEMALE SUBJECTS 


Number of 
Highest Grade Attained Subjects 


Eleventh grade or lower 26 
Twelfth grade 59 
Some college 35 


Four years of college or more 


TABLE IVa 


CORRELATION COEFFICIENTS OF d VARIANTS WITH 
EDUCATION, I.Q., AND AGE 


Variant Education I.Q. 


*Significant at .05 or above. 


TABLE IVb 


CHANCE PROBABILITY FOR RELATIONSHIPS BE- 
TWEEN GREEK d, MODIFIED GREEK d, AND 
EDUCATION, I.Q., AND AGE* 


Variant Education 1.Q. Age 


161 .10 


. 356 . 220 


*The one-tailed level of significance is read directly 
from the table. 
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icance is considered established at the . 05 level 
unless otherwise indicated.) Table IVb, contain- 
ing the exact probability ratios for the two infre- 
quently appearing d variants, shows each of these 
variants to be positively associated with educa- 
tional level at better than the . 01 level on a one- 
tailed test of significance. A one-tailed test was 
used because ofthe suggestion in the literature of 
the relationship between these dforms and in- 
tellectual ability (8). (The exact probability ra- 
tios for age and I.Q. showed a positive relation- 
ship between these d forms though this relation- 
ship did not reach significance.) Because of its 
resemblance to the Greek alphabet delta, graph- 
ologists have traditionally referred to thed vari- 
ant presented first in Table IVb as the Gr eek-d. 
We shall refer to both of these variants as the 
Greek-d types. 

The phi coefficients for the f and g variants 
are presented in Table V. The variants are or- 
dered so that the one having the most positive cor- 
relation with educational level is listed first and 
the variant having the strongest negative correla- 
tion is listedlast. Table V also shows the phi co- 
efficients withI.Q. and age. Incidentally, the 
phi coefficient reflects the frequency of appear- 
ance of the variants as well as the strengthof 
their relationships to other variables, so that com- 
parisons should be made with caution. 

Table V shows that there are three f variants 
which have significant positive associations with 
educational level, although none are significantly 
associated with I.Q. Among the g variants, two 
have significant positive associations both with 
educational level and I.Q. These are identified 
as the figure-8 and half-tigure-8 g. The figure- 
8 g also has a significant positive association 
with age. One g variant is significantly and neg- 
atively associated both with age and educational 
level. 

Considerable deviation from the school-copy 
model is reflected in those d, f, and g variants 
which were foundto be associated with higher ed- 
ucational level, I.Q. orage. The question arises 
how these variants deviate from the school-copy 
model. We shall consider these variants, first, 
with respect to the relative degree of simplifica- 
tion which they have undergone and, second, with 
respect tothe relative degree of motoric economy 
with which they are written. 

Simplification is rated roughly in terms of how 
much graphite or ink is used to make a particu- 
lar variant, as compared with the amount used in 
the school-copy form. Among the variants posi- 
tively associated with educational level, the 
Greek-type d’s, first and second f variants in 
Table V and the half-figure-8 g all invoive acon- 
siderable degree ofsimplification. Yet, the third 
f in Table V is among the least simplified f vari- 
ant, andthe figure-8 g, which correlates more 
highly with educational level, I.Q. and age than 


any other single variant, is less simplified than 
the last g in Table V which is negatively associ- 
ated with age and educational level. It is appar- 
ent that simplification alone cannot account for the 
obtained relationships. 

Turning now to economy, in graphology, 
economy usually refers to the amount of energy 
and time which isinvolved in the writing. Hence, 
a letter form is judged more economical if less 
time elapses and less energy is utilized between 
the termination of the preceding letter and the be- 
ginning of the following letter. An emphasis on 
rightward tending strokes, an avoidance of left- 
ward tending strokes, and a minimum of breaks 
and stoppages are therefore the key criteria. 

The d, f, andg variants, withthe exception ofthe 
second f on Table V, that were found to be signif- 
icantly associated with higher educational level, 
I.Q. or age all show a high degree of economy. 
However, the second d in Table IVa, the fourth 
and fifth f variants tn Table V, and the third and 
sixth g variants in Table V are also very econom- 
ical forms but not significantly associated with 
age, I.Q. or education. Therefore, economy 
alone also cannot account for the relationships 
which were obtained. 

Beyond having undergone simplification and 
economization, those d, f, and g variants which 
were positively associated with higher education- 
al level, I.Q. or age, also represent the most 
original deviations from the school-copy form. 
Considering the f variantsfromthis viewpoint, we 
can see that nothing original has been evolved in 
any ofthe three variants following the school-copy 
one in Table V. The transformations from the 
school-copy have been mainly in the dir ection of 
simple omission—of either, or both upper and low- 
er loops. In each of the three f variants which 
were positively associated with educational level 
we see the emergence of a new form relative to 
the school-copy model. 

In the case of the figure-8 andthe half-figure-8 
forms, the transformation when compared with 
other g forms seems even greater than in the case 
of the f. It is interesting to note what the Amer- 
ican graphologist, Louise Rice (8) has said con- 
cerning the figure-8 g; ‘‘People who use this for- 
mation. . . have a certain amount of intuition and 
instinct; they are the people who innately judge lit- 
erature and art fairly well, even though noi trained 
for such judgments. . . This g also shows innate 
understanding of humanity. ”’ 

The upper and middle zones of the Greek-d did 
not differ in as specific afashion from their school- 
copy counterparts as didthe zonal elements of the 
higher fandgforms. Yet, the Greek-d types 
taken as Gestalten, seem to embody an aesthetic 
simplicity not found inthe other d variants. Of 
the Greek-d, Louise Rice (8) has said, ‘‘It is not 
surprising to find stylists among writers and poets 
using this d exciusively, nor to find that college 
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professors and scientists innately taketo it. When 
found in ordinary writing, this formation is the 
‘straw in the wind’ which tells of the intellectual 
possibilities of the writer....”’ 

Turning now to the d and f variants which were 
negatively associated with age, and to the g vari- 
ant which was negatively associated both with age 
and educational level, we note that none of the 
three shows any evidence of originality. The f, 
of course, is the school-copy model; the g variant 
may be described as an ‘‘unfinished’’ school-copy 
g, and the d variant is a somewhat deteriorated 
or inept school-copy d. 

Table VI reveals the ‘‘of-connective’’ to have 
a significant positive association to educational 
level, I.Q. and age. The direct conversion of 
the upstroke of the o into the initial upstroke of 
the f is a radically economical measure which 
transforms the separate letters into a unified, 
simplified Gestalt. 


TABLE VI 


CORRELATION COEFFICIENT OF ‘‘of’? CON- 
NECTIVE WITH EDUCATION, I.Q., AND AGE 


Variant Education 1.Q. Age 


"7 . 23* . 35* 


*Significant at . 01 level. 


Among the twenty letter-form variants which 
we have studied, only the figure-8 g and the half- 
figure-8 g were foundto have a significant, posi- 
tive association withhigherI.Q. The ‘‘of-connec- 
tive’’—the only connective form which we included 
in this study—was also found to be associated 
with higher I.Q. At this point, we might wonder 
whether a comparably extensive study of other 
connective-form variants might yield a greater 
number of significant positive correlations with 
I.Q. than we have found among letter-form var- 
iants. To the extent that the need to produce a 
more or less legible script limits one’s freedom 
to forge new pathways, the limitation may be 
greater on the individual letter forms than on the 
modes of combining letter forms. 


Summary and Conclusions 


Each of the small-letter forms selected for 
study were written at least once in the school-copy 
manner by about 90 percent of our group of 150 
late adolescent and adult female Ss. In addition 
to the school-copy forms, we were able to clas- 
sify five variants of letter d, six variants of letter f, 
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and six variants of letter g. Tnese variants ap- 
peared in far fewer handwritings than did the 
school-copy form. Also selected for separate study 
was ahighly economical variation of the word ‘‘of’’. 

Among the d, f, and g variants, some adhered 
rather closely to the school-copy form and some 
deviated to a much greater extent. We found the 
school-copy f and one d variant to be significantly 
associated with lower age, and one g variant to be 
significantly associated with both lower age and 
lower educational level. Both the d and f variants 
departed only slightly {rom their school-copy 
counterparts. 

Among the seven letter-form variants which 
were shown to be associated with higher educa- 
tional level, there were twod variants, three f 
variants, and two gvariants. Bothg variants were 
also associated with higher I.Q. and one, with 
higher age. Allseven of these variants are clear- 
ly set off from the remaining eleven variants in 
that they combine a high degree of motoric econo- 
my with the most radical and original departures 
from the school-copy form. They combine effi- 
ciency with creativity and can be considered the 
most highly evolved of all the variants we have 
studied. The special case of the of-connective, 
which is graphologically also a highly developed 
variation, was also found to be associated with 
higher educational level, higher I.Q. and higher 
age. 

In effect, our results suggest that the female 
adult who continues to write in the fashion that 
would have pleased her elementary school teacher 
is less likely tobeas well educated, as bright, or 
as mature asthe adult who has worked her way out 
of the school-copy rut and has evolved a more ef- 
ficient and original way of writing. 

The results of the present study, in revealing 
that there is an evolutionary trend away from the 
school-copy model, have led us to wonder whether 
the values underlying the teaching of handwriting 
should be revamped. Instead of attempting to cast 
all children in the school-copy mold, perhaps the 
teacher should be taught to evaluate handwriting 
progress in the child with respect to the efficiency 
and legibility of his letter forms as they appear in 
the context of cursive writing. With this orienta- 
tion, the teacher may be less likely to make the 
error of diagnosing spontaneous, creative and 
economical deviations from the school-copy as an 
expression of poor progress. Why shouldn’t the 
child who, for one reason or another, can never 
be a facile copyist, be encouraged to persist in 
whatever unique modes of writing he discovers, so 
long as they are no less efficient nor legible than 
the school copy? It would seem that an early ac- 
ceptance by teachers of unique styles of writing 
would make writing more ofa pleasure thana chore 

for the child who is learning to write. More im- 
portant is the likelihood that many children might 
be spared repeated experiences of failure to write 
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‘“‘correctly’’. Suchexperiences might be the pre- 
dominant cause of the immature, inept handwrit- 
ings that are seen in later years—handwritings 
which persist as foci of self-consciousness, em- 
barrassment, and shame. 


FOOTNOTES 


* The authors wish toexpresstheir appreciation 


to Dr. Wallace Gobetz of the New York Uni- 
versity Testing and Advisement Center, whose 
cooperation made this study possible. 


** The Handwriting Institute, Inc., is a privately 


supported researchorganization formed to in- 
vestigate graphological and graphomotor vari- 
ables, and to collate the research of others in 
this area. 


1. In learning the school-copy model, we are all 
taught, when we write words beginning with 
any one of these four letters, that our first 
stroke should be an upstroke, originating at 
the base line. Since this beginning stroke is 
completely superfluous to the essential letter 
form, and since it tends to reduce the efficien- 
cy and the fluency of the writing, people tend 
to omit it as they mature. 


2. Scales of handwriting quality such as those of 
Ayres (1), Thorndike (12), Rosenhaus (9), are 
commonly used in the elementary schools to 
evaluate the individual child’s progress in cur- 
sive writing. The scales all typically consist 
of a graded series of handwriting samples, 
from worse to better, the best and highest 
grade sample always being an ideal school- 
copy model. 
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A STUDY OF PATHOLOGICAL DOUBTING AS 
A RESPONSE SET 


VELMA I. RUST* 


FOR YEARS test makers have been concerned 
with designing tests which will measure accurate- 
ly knowledge of content, specific abilities or skills, 
personality traits, and so on. They are interest- 
ed in eliminating, or keeping to a minimum, all 
extraneous effects caused by guessing, or mental 
or attitudinal sets onthe part of the subjects. Val- 
idity is kept high by giving special attentionto the 
wording of items, their arrangement, and keying. 

A few writers (3, 4) recently have raised ques- 
tions regarding the relationship between evidence 
of knowledge of content (inthe form of test scores) 
and a tendency tobe very hesitant about accepting 
any statement as proven. The author became 
interested in studying the response set herein 
called pathological doubting. The definition of 
a pathological doubter used by Ennis (3) isthe one 
also used here. Accordingto him, a pathological 
doubter is a person who is not just cautious, but 
who will never accept anything as proven, a per- 
son for whom ‘‘ proof’’, ‘‘ sufficient evidence’’, and 
‘*warranted’’ are inapplicable in all conceivable 
situations. 

The major purpose ofthis research was to test 
two hypotheses: 1. pathological doubters, chosen 
by the use ofcriteria based on their responses to 
selected items of the Watson-Glaser Critical 
Thinking Appraisal, consistently exhibit a pattern 
of reasoning which differs from that of the other 
subjects in the sample; and 2. the presence of a 
response set suchas pathological doubting affects 
the apparent factor content of a test of critical 
thinking. 


Related Research 


Ennis (3) has considered the validity of the 
Watson-Glaser Critical Thinking Appraisal (here- 
after referred to as the WG test) from a logical 
point of view. He asserts that the items in Parts 
2, 3, and 4 of Form Bm of this test are keyed in 
such a way as to favor the pathological doubter. 
His reasoning may be illustrated by referring to 
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Part 2 of the test, whichis entitled ‘‘ Recognition 
of Assumptions’’ and includes items 21 to 36 in- 
clusive. For each item, the student is asked to 
decide whether a given statement ‘‘necessarily’’ 
assumes another given statement. Of the sixteen 
items in this part, only four are keyed ‘‘assump- 
tion necessarily made’’. Thus, the pathological 
doubter gets three-quarters of them right. Ennis 
then analyzes Parts 3 and 4 inthe same way and 
shows that in the whole test the consistent patho- 
logical doubter could get up to sixty-seven out of 
the total of ninety-nine itemscorrect. He, there- 
fore, concludesthat the keying so favors the path- 
ological doubter that it is possible for him to be 
placed at the eighty-sixth percentile if he merely 
always chooses the ‘‘doubting’’ arswer. 

Frederiksen and Messick (4) have written an 
article in which they describe how they attempted 
to score set and content aspects of a test situation 
separately. Threetests of the report-writing type 
were used. The:three hy potheses tested may be 
stated briefly as follows: a) set scores from all 
three tests measure the same thing reliably; b) set 
scores are related to personality or other set 
measures; and c) content scores measure the same 
things reliably. The investigators also tried to 
discover whether it was ‘‘criticalness’’ that the 
set scores measured, and whether verbal knowl- 
edge and reasoning were included among the things 
measured by the content scores. Frederiksen and 
Messick believe that if the answer to a question is 
not affected by knowledge, it is as ifasubject mere- 
ly tosseda loaded coin. They, therefore, assumed 
dichotomous data and derived a simple formula 
for set scores and another for content scores. They 
obtained correlation coefficients of 0. 82 when they 
intercorrelated content scores, 0.96 when they in- 
tercorrelated set scores, and 0.05 when they in- 
tercorrelated content and set scores. Thus they 
were successful in separating content scores from 
set scores. 

The Lilinois Curriculum Program Committee 
(12) carried out aC ritical Thinking Project in 


*The author is deeply indebted to Dr. Kenneth B. Henderson and Dr. Philip J. Runkel of the University 
of Illinois for their assistance with the preparation of this article. 


The computations for this paper were done on Iliac, an electronic computer of the Digital Computer 
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which a deliberate attempt was made to improve 

the critical thinking skills of a group of high 
school students. In order to measure differences 
between experimental and control groups, three 
tests were used: Form Bm ofthe WG test, A Test 
of Critical Thinking, Form G, prepared by the 
American Council on Education (hereinafter called 
the ACECT test), and.A Test on Principles of 
Critical Thinking, Form F1.5 (hereinafter called 
the PCT test), prepared by the Illinois Critical 
Thinking Project Committee. The major hypoth- 
esis that knowledge of the principles of critical 
thinking is related to the ability to evaluate argu- 
ments andassess conclusions drawn was not con- 
firmed. Moreover, low intercorrelations were 
obtained among the three critical thinking test 
scores. The Committee, then, begantothink that 
the explanationforthis might be in the measuring 
instruments themselves. 

The author (9,10), therefore, factor analyzed 
the item scores for these three tests. She used 
a sample of 587 students consisting of all students 
who had atte mpted all items on all three tests, 
and showedthat this method of selecting the sam- 
ple did not create bias. Phi correlation coeffi- 
cients were computed and the centroid method of 
factoring employed. Factor analyses of the three 
critical thinking tests yielded only one weak gen- 
eral factor each. In view of the fact that intelli- 
gence tests, tests of psycho motor and physical 
abilities, performance tests, and tests of occu- 
pational abilities have all yielded a thoroughly 
established general factor (within a given test), 
the finding inthis case was rather surprising. 
Moreover, several investigators who have factor 
analyzed reasoning tests using procedures sim- 
ilar to that used by the author, have successfully 
isolated several factors (1, 2,5,6,8). The author 
suggested several explanations for her finding, 
one of which was that the population lacked ran- 
domness because of the presence of too many 
pathological doubters. It was thought possible 
that instructioninthe principles of critical think- 
ing had increased the subjects’ tendency to be ex- 
tremely cautious. The present study was, there- 
fore, undertaken in the hope of learning more 
about the trait herein called pathological doubting. 


Method and Results 


Item scores on thethree critical thinking tests 
mentioned above for the same sample of 587 stu- 
dents were used. An attempt was made to isolate 
those subjects suspected of being pathological 
doubters. Ennis’ assertion that the items in sub- 
tests 2, 3, and 4 of Form Bm of the WG test are 
keyed to favor the pathological doubter led the 
author to use the scores of the subjects on these 
items as the basis for dividing the 587 students 
into two groups, namely, pathological doubters 
and non-doubters. Of the 65 items in subtests 2, 
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3, and 4, 52ofthem are keyed as ‘‘assumption not 

necessarily made’’, ‘‘conclusion does not neces- 
sarily follow’’, or ‘‘conclusion does not follow be- 
yond a reasonable doubt’’. The author arbitrarily 
decided to accept getting more than 33 of these 
items correct as evidence of pathological doubting. 
The criteria used in selecting pathological doubt- 
ers, therefore, were: a) having at least 34 of the 
52 items keyed ‘‘assumption not made’’ or ‘‘con- 
clusion does not follow’’ correct, and b) having no 
more than 19 errors among the 65 items. The 
second criterion was added because it was thought 
that students who were making many errors, and 
especially if they were making errors of opposite 
kinds, were not consistent intheir thinking and, 
therefore, probably were confused and perhaps 
just guessingtheanswers. These criteria yielded 
a group of 262 pathological doubters, and a group 
of 325 non-doubters. 

Item scores for these subjects were available 
for Form Bm ofthe WGtest, Form G of the ACECT 
test and Form F1.5 of the PCT test. The 204 
items of these three tests were divided into 21 sub- 
tests. The items of the WG test have been grouped 
by the test makers into five parts: Inference (20 
items), Recognition of Assumptions (16 items), 
Deduction (25 items), Interpretation (24 items), 
and Evaluation of Arguments (14 items). The 52 
items of the ACECT test and the 53 items of the 
PCT test were grouped on the basis of natural 
breaks into nine and seven subtests respectively. 
Natural breaks sometimes were in the form of as- 
terisks placedthere by the test makers, and some- 
times were merely considered ‘‘natural’’ by the 
author because they came between groups of sim- 
ilar itemsor items relating to one situation. These 
sixteen subtests, which varied in size from 3 to 
13 items, were given the short appropriate labels 
shown in Table IV for easy reference. Subtest 
scores for the groupsof pathological doubters and 
non-doubters were obtained. 

Testing Hypothesis 1. — Pathological doubters 
chosen using criteria based on their responses to 
selected items of the WG test consistently exhibit 
a pattern of reasoning which differs from that of 
other subjects in the sample. 

Mean subtest scores were computed for the 
262 pathological doubters and for the 325 non- 
doubters. The difference between the mean sub- 
test score for the group of pathological doubters 
and that forthe group of non-doubters, for each of 
the 21 subtests, was tested for significance. In 
each case the variance was pooled and a t-test was 
made using this pooled variance. Wherever the 
frequency distribution was not approximately 
normal, a? test was also made. 

For each of the 21 subtests, except subtest 20, 
a t-test indicated that the difference between the 
mean subtest score for the 262 pathological doubt- 
ers and that for the 325 non-doubters was signifi- 
cantly different from zero beyond the . 01 level of 
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significance. Differencesof means were found to 
be significantly different from zero at the .01 
level for nine of the ten ** tests made. In the 
case of subtest 20 again, the difference was not 
significant. Table I summarizes these findings. 

A second method was used to test this hypoth- 
esis. Answerstoitems 1 to 20 in subtest 1 of the 
WG test were scaled according to whether they 
gave positive or negative evidence of doubting. 
The scaling of these responses and the subsequent 
analysis were undertaken on the reasoning that 
people who give the doubting answer to some items 
(for example, those in subtests 2, 3, or 4) will 
give doubting answers to these items also. In 
subtest 1, whichis called ‘‘Inference’’ by the test 
makers, a subject is requiredto label a statement 
as definitely true (T), probably true (PT), having 
insufficient data (ID), probably false (PF), or 
definitely false (F). The scale value allotted a 
subject for an item depended upon the keyed an- 
swer and the response given. Table II indicates 
how the various answers were scaled. This pro- 
cedure may be illustrated by reference to item 2, 
which is keyed as probably true, and to a three 
point scale consisting of the points T or F, PT or 
PF, andID. A person who is prone to accept 
state ments as true without critically analyzing 
them might respond true. On the three point 
scale, thisis one placeto the left of the keyed re- 
sponse and indicates ready acceptance ofa state- 
ment rather thanatendencyto doubt. The answer, 
therefore, is givena scale value of -l. A re- 
sponse of ID is one place to the right of PT and 
indicates a tendency tobe even more doubtful than 
the test makers consider warranted. Sucha re- 
sponse was allotted a ‘‘doubting’’ value of +1. 
Other scale values were determined in a similar 
way. For each subject a score was allotted for 
each of the 20 items of subtest 1. An overall 
doubting index was thus obtained for each subject 
by adding the 20 scores. The mean doubting score 
for the group of 262 pat hological doubters was 
compared with that for the group of 325 non- 
doubters, using a t-test. 

The scaling procedure outlined in the preced- 
ing paragraph was repeated, except that in obtain- 
ing a doubting score for an item four additional 
scale values were alsoincluded. These are list- 
ed in the last four lines of Table Il. The thinking 
behind this revision was that the direction of er- 
ror does not matter; all that is of interest here 
is whether or not a subject chooses a ‘‘doubting’’ 
answer. Again, a t-test was used to test the sig- 
nificance of the difference of mean doubting scores 
of the two groups. 

When the mean doubting index for the group of 
262 pathological doubters (0.50) was compared 
withthat for the groupof 325 non-doubters (-0.31), 
at value of 2.89 was obtained. When the revised 
scaling method was used, the difference between 
the mean doubting indices for the groups of 262 
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and 325 subjects (0. 64 and -0. 09 respectively) 
yielded at value of 2.46. Thus the mean differ- 
ence is significantly greater than zero beyond the 
.01 level of significance in thefirst case, and be- 
yond the . 02 level of significance in the second 
case. 

Testing Hypothesis 2. —The presence of a re- 
sponse set such as pathological doubting affects 
the apparent factor content of a test of critical 
thinking. 

A factor analysis of item scores for the WG test 
was carriedout forthe group of 325 non-doubters. 
Since the data were dichotomous, inter-item phi 
correlation coefficients were computed. The cen- 
troid method of factoring the correlation matrix 
was employed, and ones were placed in the diag- 
onal cells of the matrix. The findings were com- 
pared withthe results obtained by the author (9, 10) 
for the original sample of 587 which consisted of 
all subjects involved inthe Illinois Critical Think- 
ing Project who took all three critical thinking 
tests and who attempted all items on all three 
tests. Item scores for the PCT test were also 
factor analjrzed using the same procedure. 

As was the case in the author’s original re- 
search (9,10), no strong general factor was ob- 
tained for either the WG or the PCT test, when 
item scores for the 325 non-doubters were factor 
analyzed. Inthe case of the WG test the first cen- 
troid factor accounted for only 4.90 percent of the 
variance. For the PCT test this figure was 5. 48 
percent. For this reason, item scores for the 
ACECT test for the group of 325 non-doubters 
were not factor analyzed. 

A factor analysis of subtest scores for the 21 
subtests of the three critical thinking tests was 
carried out for the original sample of 587 subjects. 
Similar factor analyses were made for the group 
of 262 pathological doubters and the group of 325 
non-doubters. Pearson product-moment correla- 
tion coefficients were computed. Unities were 
placed inthe diagonal cells of the correlation ma- 
trix. Centroid factors were obtained and an at- 
tempt was made to rotate these factors to oblique 
simple structure using the oblimax procedure. 

These factor analyses of subtest scores yielded 
one rather strong general centroid factor for each 
ofthethree samples. Here the first centroid factor 
accounted for approximately 32 percent of the var- 
iance in the case of the total sample of 587 sub- 
jects, 21 percent in the case of the 262 patholog- 
ical doubters, and 22 percent in the case of the 
325 non-doubters. Table II] shows the variance 
accounted for by the first four centroid factors in 
the case of all three samples. Use of Guttman’s 
‘*lower bound for the number of common factors’’ 
(7) indicated that an attempt should be made to ro- 
tate four factors to oblique simple structure in 
each case. The oblimax method of rotation was 
employed. This yielded quite highfactor loadings, 
that is, high for reasoning factors. However, the 
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TABLE I 


MEAN SUBTEST SCORES FOR THREE TESTS OF CRITICAL THINKING 


Mean for 262 
Test and Pathological Mean for 325 
Subtest Doubters Non-Doubters 


Watson-Glaser 


. 00(1)** 


— 


5. 4 
2. 1 
4. 3 
3. 2 
8. 6 
2. 1 
2. 1 
if 6 
4. 3 


‘ 7. 08(3) 
3. 


* All values of t and x® are significant beyond the one percent level, except those for subtest 20. 
**x? values were computed where the distributions were not normal. Numbers of degrees of 
freedom are given in parentheses. 


6 
39 
a 1 12. 81 10. 49 6. 26 le 
‘ 2 12. 22 9. 70 16. 16 Pit 
3 21. 45 14. 99 7. 87 230 
4 4 17.52 14. 02 8.18 en 
5 10. 20 8. 22 8. 28 
ACECT 
6 74 15 154. 17(3) 
7 38 87. 52(2) 
8 . 09 66 
9 . 64 49 
10 66 69 50. 79(2) 
11 87 51. 92(1) 
12 33 33 68. 25(1) 
13 99 46. 24(2) 
Sof 14 . 29 36 45. 04(3) ys 
Principles 
15 4. 38 3. 75 6. 70 21. 57(2) 
16 4.54 3.97 5. 08 
17 3. 42 2. 79 5.27 
18 4.45 3. 59 7.07 
19 7. 06 5. 52 9.07 
21 5.41 


TABLE II 


SCALE FOR OBTAINING A DOUBTING SCORE FOR ITEMS 1 TO 20 OF THE 
WATSON-GLASER TEST 


Evidence of Doubting 


Positive Negative 


Keyed Answer Scale Answer Scale 
Response* Items Given Value Given Value 


Original Method of Scaling: 


T 1,17 
PT 2,9,16 


3,5, 7,8, 11, 12, 
14,18 


3,5, 7,8, 11, 12, 
14,18 


3,5, 7,8, 11, 12, 
14,18 


3,5, 7,8, 11, 12, 
14,18 


4,6,13,19 

F 4,6,13,19 
PF 10,15, 20 

Revised Method of Scaling 

Contained Additions: 

F 4,6,13,19 
PT 2,9,16 F 


PF 10, 15, 20 T 


*The abbreviation T stands for definitely true, PT for probably true, ID for insuffi- 
cient data, PF for probably false, and F for definitely false. 
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TABLE I 


THE VARIANCE ACCOUNTED FOR BY THE FIRST CENTROID 
FACTORS WHEN THE 21 SUBTEST SCORES ARE 
FACTOR ANALYZED 


Percent of Variance Accounted For 


Centroid 
Factor 


Total Sample 
N = 587 


Pathological 
Doubters 
N = 262 


Non-Doubters 
N = 325 


31.53 
5. 48 
4.55 


4. 36 


21.14 22.13 
6. 00 


5. 48 


oblimax solutions for the three samples were dif- 
ferent. They are shown in Table IV. 


Conclusions 


The findings showthe performance of the path- 
ological doubters to be definitely and consistently 
superior to that of the non-doubters. They also 
show that those subjects who tend to choose a 
doubting answer insubtests 2, 3, and 4, also ex- 
hibit the same tendency when responding to items 
in subtest 1. There is, therefore, sufficient ev- 
idence to state that the pathological doubters do 
consistently exhibit a pattern of reasoning differ- 
ent to that of the other subjects in the original 
sample of 587, and thus to accept Hypothesis 1. 
One canalso conclude that the doubters were suc- 
cessfully separated from t he non-doubters using 
the author’s arbitrarily chosen criteria which 
were basedon Ennis’ comments regarding the WG 
test. 

It is particularly interesting to note that the 
pathological doubters consistently made higher 
scores than the other subjects on all subtests. 
Perhaps subtests 2, 3, and 4 in the WG test are 
not the only ones keyed to favor the pathological 
doubter.. Onthe other hand, perhaps the patholog- 
ical doubter’s tendency to use extreme caution 
about accepting st atements indicates that he can 
evaluate arguments, knows the rules of logic, rec- 
ognizes unstated assumptions, and can invent and 
evaluate hypotheses, which are some of the skills 
the three critical thinking tests were designed to 
measure. 

Subtest 20 in the PCT test seems todiffer from 
the other subtests. It consists of three items 
only, and its mean item difficulty when computed 


for the sample of 587 was found to be only 0. 28. 
These facts may account for the difference. 

Seventy-two percent of the original sample of 
587 students were inthe experimental group. Sev- 
enty-nine percent of the group of 262 pathological 
doubters were fromthis group and only 66 percent 
of the non-doubters. Thus, there is some evi- 
dence that instruction in the principles of critical 
thinking increases the tendency to be overly cau- 
tious and to choose a ‘‘doubting’’ answer. 

When item scores were factor analyzed, only 
slight differences were observable between the 
group of non-doubters andthe whole sample of 587. 
No strong general factor was obtained in either 
case for either the WG or the PCT test. In con- 
trast, when subtest scores were factor analyzed, 
four factors were obtained, perhaps because sub- 
test scores are more significant and reliable than 
item scores. Differences in factor content, how- 
ever, were apparent. Analysis of the factor load- 
ings given in Table IV shows that the factors ob- 
tained for the three samples (the 587, the 262 
pathological doubters, and the 325 non-doubters) 
are not sufficiently alike to be considered the 
same. Not even one factor common to the three 
samples hasbeenfound. There is, therefore, ev- 
idence here to support the hypothesis that the pres- 
ence of a response set such as pathological doubt- 
ing affects the apparent factor content of a test of 
critical thinking. 
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GEOMETRIC AID IN TEACHING RECTILINEAR 
CORRELATION. 


JOHN GAITO 


Lake Forest College 


THE PURPOSE of this paper isto present a 
simple geometric aid for use in the teaching of 
rectilinear correlation. 

The coefficient of correlation may be concerned 
with the relationship bet ween a number of variables. 
In the materials to follow, the concern will be 
with just two variables, X and Y. A convenient 
means of indicating the concept of correlation is 
by a diagram in which the X variable is plotted on 
the horizontal axis and the Y variable on the ver- 
tical axis. If the points within the axes scatter in 
an upward directionfrom left to right, in a manner 
which indicates that X and Y tendto vary together, 
a positive correlationis present. If the scatter is 
downward from left to right, a negative correla- 
tionis present, indicating that X and Y tend to vary 
inversely. If there appears to be no trend pres- 
ent, then zero correlation is indicated. 

A convenient way ofteaching rectilinear corre- 
lation is to consider the scattering present as de- 
scribing an ellipse. An ellipse is completely de- 
fined by its major and minor axes. The major 
axis is the long axis, andthe minor axis is the 
short axis. An ellipse varies in shape with two 
interesting limiting cases. One limit occurs when 
the major and minor axes are equal; then the fig- 
ure is acircle. The other extreme is when the 
minor axis is equal to zero and the major axis is 
finite, in which case we have a straight line. 

First, plot the points on the correlation chart, 
or scatter diagram. Thus one obtains an approx- 
imate elliptical figure by drawing a curve which 
encloses most points and passes through some of 
the outer points. Next draw a single straight line 
through the long axis of the figure. This line rep- 
resents the trend of the scattering points. For 
descriptive purposes this can be handled quickly 
by inspection of the scatter and crudely drawing a 
line by hand. (A more precise method would be 
to draw the lines representing the regression of Y 
on X and X on Y, and then to use a line which is 
intermediate between the two to represent the 
trend.) This line would be the major axis of the 
ellipse. The minor axis would be a line drawn 
perpendicular to this line at its center. 

Having drawn the scattering of the points to 
represent an ellipse, wethen determine the mag- 
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nitude of the relationship. This magnitude could 
be determined exactly by an appropriate formula 
available. The approximate magnitude, however, 
could be ascertained by looking at the ratio of the 
minor axis tothe major axis, provided the two 
axes are drawn tothe same scale. As the minor 
axis goes to zero (orthe major axis gets very large 
relative to the minor axis), this ratio will also go 
to zero, andthe correlation coefficient will vary 
toward one. When the minor axis equals zero and 
the major axisis finite, the ratio also equals zero, 
the coefficient is one, no spread is present, and 
we have asingle straight line—with perfect corre- 
lation. (An exception occurs when the slope of the 
line representing the major axis equals zero. In 
this case, the Y variable equals a constant value 
for every X, and the line is parallel to the X axis. 
Thus, there is no change in Y with a change in X; 
Y remains the same. In this case, even though 
the minor axis is zero and the ratio is zero, the 
correlation coefficient would be zero because no 
relationship is present.) On the other hand, as the 
minor axis increases, with the major axis rela- 
tively fixed, the ratioincreases and the coefficient 
decreases. When the minor axis is equal to the 
major axis, the ratio is one, the coefficient is 
zero, the spreadis maximal, and we have a circle 
with no relationship present. 

This geometrical interpretation has value be- 
yond the elementary teaching of correlation. For 
example, it is found useful in looking at the effects 
of range of ability in the sample on the size of the 
coefficient. Let us use an example inwhich 
500 Ss have scores on a college entrance examin- 
ation, all are accepted, grade-point averages are 
available later for each, and the relationship be- 
tween examination scores and grade-point average 
is .60. If one were to plot these data on a corre- 
lation chart it would be foundthat a ratio of approx- 
imately 2/5 would occur. The ratio might be 
greater or less, but the magnitude of the ratio is 
not important for this example. Only the relative 
aspects are of consequence. Thus, let us assume 
that 2/5 is the ratio. This situation is shown in 
Figure 1. Now if, instead of allowing all 500 ap- 
plicants to enter school, we had used a cutting 
score onthe examination, the diagram would be 
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FIGURE 1 


A HYPOTHETICAL EXAMPLE IN WHICH ALL APPLI- 
CANTS ARE ACCEPTED AT A COLLEGE 


Grade Peint Average (Y) 


K 
Score on Entrance Examination (X) 


Note; The relationship indicated is .60. The ratio of the 
minor axis (A) to the major axis (B) is assumedto be 2/5 
Point K represents the cutting score which is used in 
Figure 2. 


FIGURE 2 


THE RELATIONSHIP INDICATED WHEN A NUMBER OF 
APPLICANTS TOWARD THE LOWER END OF THE X 
VARIABLE, BELOW K, HAVE BEEN ELIMINATED 


Grade Point Average (Y) 


on Entrance Examination (X) 
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changed as in Figure 2. Note that the minor axis 
has been shifted from its position in Figure 1 so 
as to be perpendiculartothe major axis at the lat- 
ter’s center; however, the minor axis is approxi- 
mately the same in magnitude as it was in Figure 
1. The major axis has decreased in size so that 
the ratio now is approximately 2/4. This increase 
in ratio would indicate a lesser degree of relation- 
shipthanis present in Figure 1. Such a procedure 
easily illustrates the effect of composition of the 
sample (as indicated by the range of the X variable) 
on the magnitude of the relationship, with a great- 


er degree of relationship present when the sample 
is heterogeneous than when the sample is homo- 
geneous. 

We have not developed an exact mathematical 
relationship between the size of the ratio and the 
size of the correlation coefficient. Intuitively, 
however, we assume that there is such a relation- 
ship, so that one could indicate the size of the co- 
efficient by knowing the size of the ratio. This 
geometrical interpretation of correlation, using an 
elliptical ratio, should be useful for teaching pur- 
poses even if it is merely of an ordinal nature. 
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